Principal Data Engineer - II

3 weeks ago Be among the first 25 applicants

Get AI-powered advice on this job and more exclusive features.

• Design, develop, and maintain scalable ETL / ELT pipelines to ingest, transform, and integrate data from various sources
• Implement real-time data streaming and batch processing solutions to support diverse business needs
• Build and optimize data storage solutions, including data lakes, data warehouses, and databases
• Ensure data systems and pipelines are scalable, secure, and performant
• Clean, transform, and prepare raw data into usable formats for analytics and machine learning
• Collaborate with Data Scientists and Analysts to define data requirements and deliver solutions
• Monitor the performance and reliability of data pipelines and systems, implementing improvements where necessary
• Troubleshoot and resolve data-related issues, ensuring minimal downtime
• Implement and enforce data quality checks, validation processes, and monitoring mechanisms
• Collaborate with Data Governance teams to ensure data complies with organizational standards and policies
• Work closely with cross-functional teams, including Data Architects, Analysts, and Business Teams, to understand requirements and deliver data solutions
• Provide technical expertise and guidance on data engineering best practices
• Stay updated on emerging tools, technologies, and industry trends
• Evaluate and recommend technologies to enhance data engineering capabilities
• Design, develop, and maintain scalable ETL / ELT pipelines to ingest, transform, and integrate data from various sources
• Implement real-time data streaming and batch processing solutions to support diverse business needs
• Build and optimize data storage solutions, including data lakes, data warehouses, and databases
• Ensure data systems and pipelines are scalable, secure, and performant
• Clean, transform, and prepare raw data into usable formats for analytics and machine learning
• Collaborate with Data Scientists and Analysts to define data requirements and deliver solutions
• Monitor the performance and reliability of data pipelines and systems, implementing improvements where necessary
• Troubleshoot and resolve data-related issues, ensuring minimal downtime
• Implement and enforce data quality checks, validation processes, and monitoring mechanisms
• Collaborate with Data Governance teams to ensure data complies with organizational standards and policies
• Work closely with cross-functional teams, including Data Architects, Analysts, and Business Teams, to understand requirements and deliver data solutions
• Provide technical expertise and guidance on data engineering best practices
• Stay updated on emerging tools, technologies, and industry trends
• Evaluate and recommend technologies to enhance data engineering capabilities

Requirements

Benefits

Seniority level

Seniority level

Mid-Senior level

Employment type

Employment type

Full-time

Job function

Job function

Other

Industries

IT Services and IT Consulting

Referrals increase your chances of interviewing at Pakistan Single Window (PSW) by 2x

Karachi Division, Sindh, Pakistan 3 hours ago

Karachi Division, Sindh, Pakistan 3 months ago

Karachi Division, Sindh, Pakistan 4 months ago

Principal Software Support Engineer-II (L3)

Karachi Division, Sindh, Pakistan 5 days ago

Senior Software Engineer I - AI (Contract)

Karachi Division, Sindh, Pakistan 6 months ago

Senior Software Engineer- D365 Development

Karachi Division, Sindh, Pakistan 5 days ago

Karachi Division, Sindh, Pakistan 4 hours ago

Karachi Division, Sindh, Pakistan 5 months ago

Full Stack Software Engineer (.NET Core & Angular)

We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.

#J-18808-Ljbffr