Log In
Sign Up
Job Description
You will be responsible for designing, implementing, and maintaining robust data pipelines and ETL processes. With your expertise in Spark, Talend, Airflow, Python, and SQL, you will ensure the efficient flow and transformation of data across our systems.
Key Responsibilities:
Data Pipeline Development: Design and develop scalable data pipelines using Apache Spark, ensuring efficient data processing and transformation.
ETL Processes: Create and manage ETL (Extract, Transform, Load) workflows to integrate data from multiple sources into our data systems.
Data Integration: Utilize Talend for data integration tasks, including data cleansing, transformation, and loading.
Workflow Automation: Implement and manage data workflows using Apache Airflow to automate and optimize data processing tasks.
Programming: Leverage Python to write scripts for data manipulation, transformation, and analysis.
Database Management: Develop and optimize SQL queries for efficient data retrieval and analysis in relational databases.
Collaboration: Work closely with data scientists, analysts, and other stakeholders to understand data needs and deliver effective solutions.
Data Quality: Ensure data accuracy, consistency, and quality through rigorous validation and monitoring processes.
Documentation: Create and maintain detailed documentation for data processes, pipelines, and integration workflows.
Required Skills and Qualifications:
Proficiency in Apache Spark for large-scale data processing and analytics.
Experience with ETL processes and tools, including Talend.
Familiarity with Apache Airflow for managing data workflows and automation.
Strong programming skills in Python for data engineering tasks.
Advanced SQL skills for querying and managing relational databases.
DATA PRIVACY:
Novare values your privacy. By submitting your application, you hereby authorize Novare and its Affiliates to collect and process your Personal Information and Sensitive Personal Information (as defined under R.A. No. 10173 or the Data Privacy Act) contained in your resume and other documents and information provided to the Company for the processing of your job application. Your data is stored in Novare’s secure databases and retained until the expiration of the retention limit provided by law or when you revoke your consent.
Salary
About Us
Founded in 1988, MDI Novare is a pioneer and champion in the Philippine ICT market. Over the past three decades, MDI Novare has driven digital transformation through custom application development, infrastructure, data analytics, and IT security solutions that meet and exceed business demands. Today, MDI Novare continues its culture of innovation by being at the forefront of major technology trends such as APIs, cloud computing, big data, AI, and automation as we strive to create a positive impact for our people, our clients, our partners, and our communities.
#TheFutureIsOurs
Founded in 1988, MDI Novare is a pioneer and champion in the Philippine ICT market. Over the past three decades, MDI Novare has driven digital transformation through custom application development, infrastructure, data analytics, and IT security solutions that meet and exceed business demands. Today, MDI Novare continues its culture of innovation by being at the forefront of major technology trends such as APIs, cloud computing, big data, AI, and automation as we strive to create a positive impact for our people, our clients, our partners, and our communities.
#TheFutureIsOurs
