Lead Data Engineer (AWS Data Platform)
Tasks
- Build and optimize data ingestion transformations processing
- Collaborate with stakeholders analysts architects to understand data requirements
- Conduct code reviews and technical design discussions
- Create and maintain technical documentation data models operational procedures
- Design scalable data pipelines
- Develop and maintain Amazon Redshift data warehouse solutions
- Develop and optimize ETL ELT frameworks
- Ensure data quality integrity security governance
- Monitor pipelines and identify performance improvements and automation opportunities
- Troubleshoot production data incidents and perform root cause analysis
- Tune performance of Spark jobs ETL pipelines SQL and Redshift workloads
- Write complex SQL queries stored procedures data transformations
Perks/Benefits
- N/A
Skills/Tech-stack
AWS Glue | AWS IAM | AWS Lambda | AWS Step Functions | Agile | Amazon CloudWatch | Amazon EMR | Amazon Redshift | Amazon S3 | CI/CD | Compliance | Data Governance | Data Security | Data Warehousing | DevOps | Dimensional Modeling | ELT | ETL | PySpark | SQL | Scrum | Step Functions | Workflow Orchestration
Roles
Data Engineer | Engineer | Lead | Lead Data | Lead Data Engineer
Related jobs
-
AI Engineer INR 2000K-5000KAI Agents | API Integration | Asynchronous processing | Cloud Native | Cloud Native ServicesMid-level Full TimeIslamabad, Pakistan3h ago
-
Mid-level Full TimePakistan2d ago
-
Senior Data Engineer USD 120K-165KAWS | Apache Airflow | Apache Spark | CI/CD | DockerContinuing education program | Continuous learning | Flexible time off | Health care coverage | Retirement planningSenior-level Full TimeIN - HYDERABAD SKYVIEW, India2d ago
-
Principal Data Engineer USD 126K-170KApache Delta | Apache Delta Lake | Apache Spark | Azure Blob | Azure Blob StorageSenior-level Full TimeLahore, Pakistan3d ago
-
AI/ML Engineer USD 125K-198KAPI Integration | AWS IAM | AWS Lambda | Amazon Bedrock | Amazon S3Onsite work environmentSenior-level Full TimeLahore, Pakistan3d ago
-
Azure Data | Azure Data Factory | Azure Machine Learning | CI/CD | Data AnalysisCoaching and feedback | Continuous learning | Diverse, inclusive culture | Flexible work approachSenior-level Full TimeKarachi, PK, 756004d ago
-
Associate AI Engineer USD 120K-171KAlgorithms | Artificial Intelligence | Data Structures | Deep learning | GitCareer growth | Company sponsored training | Company vehicle financing | Health coverage for family | In-house daycareMid-level Full TimeLahore, Pakistan4d ago
-
Sr Finance and Workflow Automation Lead (AI-Driven) USD 151K-200KAPI Integration | Anomaly Detection | Artificial Intelligence | Budgeting | Data VisualizationSenior-level Full TimeLahore, Pakistan7d ago
-
Staff Data Engineer - (.NET / Angular / PostgresSQL) USD 135K-199KAgile | Amazon Redshift | Angular | Azure Synapse | Azure Synapse AnalyticsSenior-level Full TimeLahore, Karachi, Islamabad7d ago
-
Senior AI Agent Engineer USD 140K-204KAgent systems | Agentic Systems | Authentication | Authorization | CI/CDAmazing work culture | Free Lunch Facility | Fuel allowance | Group life insurance | Gym membershipSenior-level Full TimeIslamabad, Islamabad Capital Territory, Pakistan7d ago
-
APIs | AWS | Azure | ChromaDB | Data ProcessingMid-level Full TimePakistan - Remote R8d ago
-
Senior Data Engineer - II USD 96K-195KAccess Control | Data Integrator | Data Lakes | Data Modeling | Data QualityFuel card | Health benefits | Inclusive work culture | Professional development opportunitiesSenior-level Full TimeKarachi, Sindh, Pakistan8d ago
-
Data Engineer - II USD 107K-151KData Integrator | Data Modeling | Data Quality | Data Security | Data pipelineFuel card | Health benefits | Inclusive work culture | Professional development opportunitiesSenior-level Full TimeKarachi, Sindh, Pakistan8d ago
-
Senior-level Full TimeLahore, Punjab, Pakistan9d ago
-
Data Engineer (Data Bricks) INR 1300K-2000KAWS Glue | Amazon Kinesis | Amazon Redshift | Apache Airflow | Apache KafkaMid-level Full TimeIslamabad, Islamabad9d ago
-
Senior - AI Engineer USD 122K-164K.NET | Agentic Workflows | Data Pipelines | Data Processing | Data VisualizationSenior-level Full TimeIslamabad, Federal territory9d ago
-
Entry-level Full TimeKharian, Punjab9d ago
-
Data Engineer (Data Bricks) INR 1500K-2500KAWS Glue | Amazon Kinesis | Amazon Redshift | Apache Airflow | Apache KafkaSenior-level Full TimeIslamabad, Islamabad10d ago
-
Data Engineer USD 160K-200KAgile | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageRemote workSenior-level Full TimeIslamabad, Federal Teritory10d ago
-
Senior Data Engineer - Azure USD 119K-258KApache Spark | Azure Data | Azure Data Factory | Azure Synapse | Azure Synapse AnalyticsSenior-level Full TimeLahore, Pakistan11d ago
-
Senior-level Full TimeIslamabad, Pakistan11d ago
-
AWS | Access Control | Airflow | Amazon Redshift | AzureIPD | Medical insurance | Medical leave | OPD | Paid time offSenior-level Full TimeIslamabad, Pakistan12d ago
-
AWS | Amazon Redshift | Apache NiFi | Azure | Cloud platformMid-level Full TimeIslamabad, Pakistan14d ago
-
Database Engineer ZAR 464K-464KAI tools | AWS RDS | Azure SQL | Cloud Databases | Data MigrationBi-annual increment | Car support program | Career growth | EOBI | Health insuranceMid-level Full TimeKarachi, Sindh, Pakistan15d ago
-
Data Engineer USD 103K-122KAzure Data | Azure Data Factory | Azure Databricks | Azure Functions | Azure Key VaultAccess to in house gym | Complimentary meals | Health insurance | Life insurance | Voluntary pension schemeEntry-level Full TimePakistan15d ago