Data Engineer

Role: Data Engineer
Location: Remote - Offshore India
Employment: Offshore / Remote
Hourly pay: 7/hr
Experience: 7+ years

Job Description:

We need a hands-on Data Engineer to develop, maintain, monitor, troubleshoot, and optimize our existing Amazon Redshift data warehouse and associated data integration workflows.

Core Responsibilities:

1. Production Support: Monitor ETL jobs & Redshift workloads, resolve failures, performance bottlenecks, data discrepancies. Develop monitoring scripts, alerts, dashboards. Rotational on-call support.

2. Redshift & ETL Development: Design, develop, deploy Redshift solutions. Complex SQL tuning, Python + S3 + AWS data services, job scheduling, error handling, retry mechanisms.

3. Data Quality: Build validation checks, reconciliation, support Tableau workloads, troubleshoot downstream reporting issues.

4. Migration Project: Support phased transition from Redshift to Databricks. Learn Databricks SQL, PySpark, Delta Lake, Workflows, Unity Catalog, Medallion Architecture (Bronze/Silver/Gold).

Required Qualifications:

* Strong hands-on Amazon Redshift, Complex SQL, Production Support & On-call experience

* Expertise in SQL tuning, debugging, deployment

* Python for ETL automation & monitoring utilities

* Amazon S3 & AWS integration workflows

* Experience supporting Tableau / BI platforms

* Willingness and ability to learn Databricks