Data Engineer in Test
Confiz LimitedGujrat, Punjab, Pakistan30+ days ago
Job descriptionBachelor’s degree in computer science or related discipline 3-6 years of hands-on experience in Data Engineering particularly in Data Lake environments on Azure's cloud platform. Proficient in Azure Data Factory, Azure Synapse Analytics and Databricks for big data processing and scaled data quality checks. Proficiency in SQL, capable of writing and optimizing both simple and complex queries for data validation and testing purposes. Proficient in PySpark, with experience in data manipulation and transformation, and a demonstrated ability to write and execute test scripts for data processing and validation. Hands-on experience with Functional & system integration testing in big data environments, ensuring seamless data flow and accuracy across multiple systems. Knowledge and ability to design and execute test cases in a behaviour-driven development environment. Fluency in Agile methodologies, with active participation in Scrum ceremonies and a strong understanding of Agile principles. Familiarity with tools like Jira, including experience with X-Ray or Jira Zephyr for defect management and test case management. Proven experience working on high-traffic and large-scale software products, ensuring data quality, reliability, and performance under demanding conditions. Identify and resolve issues in complex Big Data environments, ensuring data accuracy and system efficiency. Initiate and manage tasks, delivering high-quality results within deadlines in a dynamic setting. Confidently challenge existing assumptions and processes to enhance data engineering and QA practices. Maintain organized testing schedules and documentation, ensuring thorough coverage of all scenarios. Exhibit strong interpersonal skills, working effectively in cross-functional, multicultural teams with minimal supervision. Comfortable in Agile and Scrum environments, proficient with tools like Jira, and adaptable to changing priorities. Manage multiple projects simultaneously, demonstrating strong planning and organizational skills to ensure timely task completion.
We are undergoing a significant data transformation to ensure that accurate and consistent data is available precisely when and where it's needed.
Responsibilities :
- Write PySpark and SQL scripts to validate data pipelines, transformations, and integrations.
- Design and run tests for data validation, storage, and retrieval using Azure services like Data Lake, Synapse, and Data Factory, adhering to industry standards.
- Continuously enhance automated tests as new features are developed, ensuring Participate in data reconciliation and verify Data Quality frameworks to maintain data accuracy, completeness, and consistency across the platform.
- Formulate and maintain test strategies—including smoke, performance, functional, and regression testing—to ensure data processing and ETL jobs meet requirements.
- Collaborate with development teams to assess changes in data workflows and update test cases to preserve data integrity.
- Share knowledge and best practices by collaborating with business analysts and technology teams to document testing processes and findings.
- Communicate testing progress effectively with stakeholders, highlighting issues or blockers, and ensuring alignment with business objectives.
- Maintain a comprehensive understanding of the Azure Data Lake platform's data landscape to ensure thorough testing coverage.
Requirements :
We have an amazing team of 700+ individuals working on highly innovative enterpriseprojects & products. Our customer base includes Fortune 5retail and CPGcompanies, leadingstore chains, fast-growth fintech, and multipleSilicon Valley startups.
What makes Confiz stand out is our focus on processes and culture. Confiz is ISO 9001 : 2015 (QMS), ISO 27001 : 2022 (ISMS), ISO 20000-1 : 2018 (ITSM) and ISO 14001 : 2015 (EMS) Certified. We have a vibrant culture of learning via collaboration and makingworkplace fun.
People who work with us work with cutting-edge technologies while contributing success to the company as well as to themselves.
To know more about Confiz Limited, visit :
#J-18808-Ljbffr
Create a job alert for this search
Data Engineer • Gujrat, Punjab, Pakistan
Related jobs
)
- Promoted
Senior Software Development Engineer in Test - SDET
PackageXGujrat, Punjab, Pakistan PackageX is revolutionizing the logistics industry with the world's first API First Logistics Cloud.PackageX empowers retail and commercial enterprises to achieve unprecedented success by deliverin...Show moreLast updated: 9 days ago
- Promoted
Senior Data Engineer
traxccelGujrat, Punjab, Pakistan We are looking for a highly experienced and motivated Azure Data Engineer to join our team.The successful candidate will have a minimum of 5 years of hands‑on experience in Azure and Databricks arc...Show moreLast updated: 1 day ago
- Promoted
Test Automation Engineer
QA BrainsJhelum, Punjab, Pakistan Job Title : Test Automation Engineer###### Company Name : AhoyJob Type : RemoteLocation : Karachi, Sindh , Pakistan### Description • •Company Profile • • AHOY is a dynamic venture studio based in the vibr...Show moreLast updated: 25 days ago
- Promoted
SQA Engineer - I (Contractual - Remote)
Pakistan Single Window (PSW)Gujrat Division, Punjab, Pakistan Ensure good quality standards for product delivery and their compliance with user requirements.Evaluate and test software applications according to business and functional requirements.Provide feed...Show moreLast updated: 30+ days ago
- Promoted
Data Engineer
CreativechaosGujrat Division, Punjab, Pakistan We are seeking a highly skilled Data Engineer with extensive experience in Azure Data Lake to contribute to our dynamic team at Creative Chaos.
The ideal candidate will be responsible for architecti...Show moreLast updated: 30+ days ago
- Promoted
Data Engineer
Creative ChaosGujrat, Punjab, Pakistan We are seeking a highly skilled Data Engineer with extensive experience in Azure Data Lake to contribute to our dynamic team at Creative Chaos.
The ideal candidate will be responsible for architecti...Show moreLast updated: 30+ days ago
- Promoted
Azure Data Integration Engineer (DP600 / 700)
ITC WorldwideGujranwala Division, Punjab, Pakistan Azure Data Integration Engineer (DP600 / 700).The role involves building and managing data pipelines, troubleshooting issues, and ensuring data accuracy across platforms such as Azure Synapse Analyti...Show moreLast updated: 30+ days ago
- Promoted
Quality Assurance Engineer
Solace Ltd.Gujrat Division, Punjab, Pakistan At Revel Health Ai, we're building cutting-edge AI-powered tools for healthcare providers.Our mission is to deliver product that is both powerful and easy to use—helping our customers work smarter ...Show moreLast updated: 30+ days ago
- Promoted
Data Engineer in Test
Confiz LimitedGujrat, Pakistan We are undergoing a significant data transformation to ensure that accurate and consistent data is available precisely when and where it's needed.
Responsibilities : Write PySpark and SQL scripts to ...Show moreLast updated: 30+ days ago
- Promoted
Senior Data Engineer - 100% Remote
Hyly.AIGujrat Division, Punjab, Pakistan AI is the multifamily industry’s premier Intelligence Fabric™, combining Artificial, Business, and Human intelligence into one unified operating system for growth.
The platform transforms raw data i...Show moreLast updated: 1 day ago
- Promoted
Lead Data Engineer
FusemachinesJhelum, Punjab, Pakistan Fusemachines is a leading AI strategy, talent, and education services provider.Adjunct Associate Professor at Columbia University, Fusemachines has a core mission of democratizing AI.With a presenc...Show moreLast updated: 25 days ago
- Promoted
47172418819- Senior QA Engineer / QA Lead - End-to-End Testing
Activate TalentGujranwala Division, Punjab, Pakistan Location : 100% Remote, US Time (EST) Employment Type : Full-time.About the Role : Our client is seeking a highly experienced Senior QA Engineer / QA Lead to take ownership of end-to-end testing for t...Show moreLast updated: 10 days ago
- Promoted
Senior Data Engineer
Creative ChaosGujrat, Punjab, Pakistan Be among the first 25 applicants.We are seeking a highly skilled Senior Data Engineer to join our dynamic team.The ideal candidate will have a strong background in designing and implementing data p...Show moreLast updated: 30+ days ago
- Promoted
AI Code Fixing Engineer
Ryz LabsGujranwala Division, Punjab, Pakistan The role involves debugging, repairing, and optimizing code to enhance overall system performance.Analyze and correct defects in existing codebases.
Collaborate with developers and cross-functional ...Show moreLast updated: 30+ days ago
- Promoted
Data Engineer - M&A (Remote)
360trainingGujranwala Division, Punjab, Pakistan Over the years, we have continued to grow our expansive library of regulatory‑approved training courses with new content suited for today’s modern workforce.
By offering these courses online, all 36...Show moreLast updated: 19 days ago
- Promoted
QA Automation Engineer - FT (Pakistan Remote)
Care1Gujrat, Punjab, Pakistan QA Automation Engineer - FT (Pakistan Remote).QA Automation Engineer - FT (Pakistan Remote).Care1 is seeking an experienced full time.
Pakistan based team of engineers.To ensure effective collaborat...Show moreLast updated: 1 day ago
- Promoted
Databricks Engineer - Remote - Pakistan
FullStack LabsGujrat Division, Punjab, Pakistan FullStack is the most transparent IT talent network, connecting highly skilled individuals with top global companies and Silicon Valley startups for remote, on‑demand projects.We focus on building ...Show moreLast updated: 10 days ago
- Promoted
Data Engineer
Burq, Inc.Gujrat, Punjab, Pakistan Burq started with an ambitious mission : how can we turn the complex process of offering delivery into a simple turnkey solution.
It’s a big mission and now we want you to join us to make it even big...Show moreLast updated: 30+ days ago