This job offer is not available in your country.

Data Engineer in Test

Confiz LimitedIslamabad, Islamabad Capital Territory, Pakistan

18 days ago

Job description

We are undergoing a significant data transformation to ensure that accurate and consistent data is available precisely when and where it's needed.

Responsibilities :

Write PySpark and SQL scripts to validate data pipelines, transformations, and integrations.
Design and run tests for data validation, storage, and retrieval using Azure services like Data Lake, Synapse, and Data Factory, adhering to industry standards.
Continuously enhance automated tests as new features are developed, ensuring Participate in data reconciliation and verify Data Quality frameworks to maintain data accuracy, completeness, and consistency across the platform.
Formulate and maintain test strategies—including smoke, performance, functional, and regression testing—to ensure data processing and ETL jobs meet requirements.
Collaborate with development teams to assess changes in data workflows and update test cases to preserve data integrity.
Share knowledge and best practices by collaborating with business analysts and technology teams to document testing processes and findings.
Communicate testing progress effectively with stakeholders, highlighting issues or blockers, and ensuring alignment with business objectives.
Maintain a comprehensive understanding of the Azure Data Lake platform's data landscape to ensure thorough testing coverage.

Requirements :

Bachelor’s degree in computer science or related discipline

3-6 years of hands-on experience in Data Engineering particularly in Data Lake environments on Azure's cloud platform.

Proficient in Azure Data Factory, Azure Synapse Analytics and Databricks for big data processing and scaled data quality checks.

Proficiency in SQL, capable of writing and optimizing both simple and complex queries for data validation and testing purposes.

Proficient in PySpark, with experience in data manipulation and transformation, and a demonstrated ability to write and execute test scripts for data processing and validation.

Hands-on experience with Functional & system integration testing in big data environments, ensuring seamless data flow and accuracy across multiple systems.

Knowledge and ability to design and execute test cases in a behaviour-driven development environment.

Fluency in Agile methodologies, with active participation in Scrum ceremonies and a strong understanding of Agile principles.

Familiarity with tools like Jira, including experience with X-Ray or Jira Zephyr for defect management and test case management.

Proven experience working on high-traffic and large-scale software products, ensuring data quality, reliability, and performance under demanding conditions.

Identify and resolve issues in complex Big Data environments, ensuring data accuracy and system efficiency.

Initiate and manage tasks, delivering high-quality results within deadlines in a dynamic setting.

Confidently challenge existing assumptions and processes to enhance data engineering and QA practices.

Maintain organized testing schedules and documentation, ensuring thorough coverage of all scenarios.

Exhibit strong interpersonal skills, working effectively in cross-functional, multicultural teams with minimal supervision.

Comfortable in Agile and Scrum environments, proficient with tools like Jira, and adaptable to changing priorities.

Manage multiple projects simultaneously, demonstrating strong planning and organizational skills to ensure timely task completion.

We have an amazing team of 700+ individuals working on highly innovative enterpriseprojects & products. Our customer base includes Fortune 5retail and CPGcompanies, leadingstore chains, fast-growth fintech, and multipleSilicon Valley startups.

What makes Confiz stand out is our focus on processes and culture. Confiz is ISO 9001 : 2015 (QMS), ISO 27001 : 2022 (ISMS), ISO 20000-1 : 2018 (ITSM) and ISO 14001 : 2015 (EMS) Certified. We have a vibrant culture of learning via collaboration and makingworkplace fun.

People who work with us work with cutting-edge technologies while contributing success to the company as well as to themselves.

To know more about Confiz Limited, visit :

#J-18808-Ljbffr

Create a job alert for this search

Data Engineer • Islamabad, Islamabad Capital Territory, Pakistan

Related jobs

Promoted

Software Engineer in Test

Elixir Technologies CorporationIslamabad, Islamabad Capital Territory, Pakistan

Reporting to the Manager, Quality Assurance, the Software Engineer in Test (SET) is a motivated, mid-level individual contributor and a key member of the engineering team responsible for owning the...Show moreLast updated: 30+ days ago

Promoted

Software Development Engineer in Test II

S&P GlobalIslamabad, Pakistan

Software Development Engineer in Test II at S&P Global.This role involves building solutions to test applications across Web / Windows / Mobile / API / Services, framing efficient data comparison methods, ...Show moreLast updated: 30+ days ago

Principal Test Automation Engineer

Creative ChaosIslamabad, Islamabad, PK

Quick Apply

Job Duties and Responsibilities : .Provide expert opinion and guidance on business & quality parameters.Develop test automation framework, and continue to enhance and modify based on project need...Show moreLast updated: 30+ days ago

Promoted

Data Engineer in Test

ConfizIslamabad, Islamabad Capital Territory, Pakistan

We are undergoing a significant data transformation to ensure that accurate and consistent data is available precisely when and where it's needed. Write PySpark and SQL scripts to validate data pipe...Show moreLast updated: 30+ days ago

Promoted

Senior Test Engineer

SWATXIslamabad, Pakistan

SWATX is looking for an experienced Senior Test Engineer to join our innovative team.In this pivotal role, you will lead the testing efforts for our software products, ensuring the highest standard...Show moreLast updated: 30+ days ago

Promoted

Data Engineer

EdgeIslamabad, Islamabad Capital Territory, Pakistan

We’re on a mission to eliminate geographic borders as barriers to full-time employment and fair wages.We’re creating a global HR platform ecosystem that seamlessly connects exceptional talent world...Show moreLast updated: 30+ days ago

Promoted

Q / A Engineer

PackageX, Inc.Islamabad, Pakistan

PackageX automates data entry and manual logistics processes for receiving, inventory, and fulfilment in buildings, warehouses, and stores. It uses advanced AI scanning, flexible bolt-on apps, and A...Show moreLast updated: 14 days ago

Promoted
New!

Senior Quality Assurance Engineer

DigyCorpIslamabad, Islamabad Capital Territory, Pakistan

Senior Quality Assurance Engineer.This role is ideal for a professional with strong JavaScript skills, hands-on experience with Cypress or Playwright, and a solid background in cloud-based testing....Show moreLast updated: 22 hours ago

Promoted

Senior Test Automation Engineer

Creative ChaosIslamabad, Islamabad Capital Territory, Pakistan

Job Duties and Responsibilities : .As a seasoned QA resource in project teams, provide expert opinion and guidance on business & quality parameters. Develop test automation framework, and continue to ...Show moreLast updated: 30+ days ago

Data Engineer

Creative ChaosPK

Quick Apply

We are seeking a highly skilled Data Engineer with extensive experience in Azure Data Lake to contribute to our dynamic team at Creative Chaos. The ideal candidate will be responsible for architecti...Show moreLast updated: 30+ days ago

Promoted

Senior C# / .NET Engineer

S&P Global, Inc.Islamabad, Islamabad Capital Territory, Pakistan

Grade Level (for internal use) : .Our team is responsible for the design, architecture, and development of data products using a variety of tools that are regularly updated as modern technologies eme...Show moreLast updated: 30+ days ago

Promoted

Senior C# / .NET Engineer

S&P GlobalIslamabad, Islamabad Capital Territory, Pakistan

Promoted

Data Engineer

CreativechaosIslamabad, Islamabad Capital Territory, Pakistan

Promoted

Senior Data Engineer

CloudPSO.comIslamabad, Islamabad Capital Territory, Pakistan

Mon - Fri 6 PM - 3 AM Pakistan time.Able to work on complex data intensive projects.Good understating of Python, Spark best practices and commonly used modules based on work experience and creating...Show moreLast updated: 30+ days ago

Promoted

Principal Engineer - GenAI, Big Data

Leverify LLCIslamabad, Islamabad Capital Territory, Pakistan

Location - Hybrid for Islamabad; Remote for other cities.Lead the design, architecture, and development of next-generation intelligent systems at the intersection of Generative AI, Big Data, and Cl...Show moreLast updated: 1 day ago

Promoted

Data Engineer in Test

Confiz LimitedRawalpindi Cantonment, Pakistan

We are undergoing a significant data transformation to ensure that accurate and consistent data is available precisely when and where it's needed. Responsibilities : Write PySpark and SQL scripts to ...Show moreLast updated: 12 days ago

Promoted

Test Engineer

SWATXIslamabad, Pakistan

SWATX is seeking a dedicated Test Engineer to join our dynamic team.The ideal candidate will be responsible for designing, developing, and executing test plans and cases to ensure the quality and f...Show moreLast updated: 30+ days ago

Promoted

Senior / Principal Test Automation Engineer

Creative ChaosIslamabad, Islamabad Capital Territory, Pakistan

Principal Engineer - GenAI, Big Data

Leverify GroupPK

Quick Apply

Role - Principal Engineer Location - Hybrid for Islamabad Remote for other cities Role Summary : Lead the design, architecture, and development of next-generation intelligent systems at the intersec...Show moreLast updated: 5 days ago

Promoted

Senior Data Engineer

BackbaseIslamabad, Islamabad Capital Territory, Pakistan

At Backbase, we're reimagining the future of banking through data and intelligence.Our Engagement Banking Platform enables financial institutions to deliver seamless, personalized customer experien...Show moreLast updated: 7 days ago