Lead Data Engineer (AWS Data Platform)
Tasks
- Build and optimize data ingestion transformations processing
- Collaborate with stakeholders analysts architects to understand data requirements
- Conduct code reviews and technical design discussions
- Create and maintain technical documentation data models operational procedures
- Design scalable data pipelines
- Develop and maintain Amazon Redshift data warehouse solutions
- Develop and optimize ETL ELT frameworks
- Ensure data quality integrity security governance
- Monitor pipelines and identify performance improvements and automation opportunities
- Troubleshoot production data incidents and perform root cause analysis
- Tune performance of Spark jobs ETL pipelines SQL and Redshift workloads
- Write complex SQL queries stored procedures data transformations
Perks/Benefits
- N/A
Skills/Tech-stack
AWS Glue | AWS IAM | AWS Lambda | AWS Step Functions | Agile | Amazon CloudWatch | Amazon EMR | Amazon Redshift | Amazon S3 | CI/CD | Compliance | Data Governance | Data Security | Data Warehousing | DevOps | Dimensional Modeling | ELT | ETL | PySpark | SQL | Scrum | Step Functions | Workflow Orchestration
Roles
Data Engineer | Engineer | Lead | Lead Data | Lead Data Engineer
Related jobs
-
Analytics Cloud | Business Data Cloud | Data cloud | Data integration | ETLLearning and development opportunitiesExecutive-level Full TimeLahore, Pakistan2d ago
-
AI Solution Engineer (Agentic & Prompt) INR 2000K-5000KAssistants API | ELT | ETL | FastAPI | FlaskMid-level Full TimeLahore, Pakistan4d ago
-
Senior Software Engineer, Dev USD 108K-170KAPI Integration | Authentication | Conversational AI | Function Calling | GitSenior-level Full TimeLahore (Ibex 2)9d ago
-
AWS Bedrock | AWS Lambda | Agentic AI | Context engineering | EvaluationLaptop provided | Mentorship | No weekend work | Remote-firstMid-level Full TimePakistan R10d ago
-
Apache Airflow | Apache Spark | Batch Processing | Data Governance | Data ModelingCareer growth | Full-time contract | Remote-first work environmentSenior-level Contract Full TimePakistan R10d ago
-
Senior Data Engineer USD 119K-258KApache Spark | Azure Data | Azure Data Factory | Azure Synapse | Azure Synapse AnalyticsSenior-level Full TimeLahore, Pakistan11d ago
-
Mid-level Full TimeLahore - Punjab - Pakistan12d ago
-
Azure AI Engineer - Pakistan INR 1200K-2500KAI Services | ARM | Agile | App Service | Application InsightsMid-level Full TimeIslamabad, Pakistan13d ago
-
Principal AI Engineer INR 3600K-4972KAI Agents | AI Services | Azure AI | Azure AI Services | Azure DevOpsSenior-level Full TimeKarachi, Pakistan, Pakistan14d ago
-
Senior-level Full TimeIslamabad, Pakistan, Pakistan14d ago
-
ARM | Azure | Azure Blob | Azure Blob Storage | Azure DataMid-level Full TimeKarachi, Pakistan R18d ago
-
Data Engineer INR 2000K-2500KAzure | Azure Data | Azure Data Factory | Data Factory | Data ModelingChild care facility | Conveyance allowance | Home internet subsidy | Leave encashment | Life benefitMid-level Full TimePER - Lahore, PK, Pakistan19d ago
-
Associate Team Lead- Data Engineer USD 125K-165KAWS | AWS Glue | Amazon Redshift | Apache Airflow | AzureSenior-level Full TimeLahore, Punjab, Pakistan20d ago
-
Amazon Kinesis | Amazon Redshift | Apache Airflow | BigQuery | CI/CDRemote work | U.S. business hoursSenior-level Full TimePakistan - Remote R21d ago
-
Senior Data Engineer INR 1500K-2500KAWS Glue | Apache Kafka | Apache Spark | Azure | Data ModelingHealth insurance | Life insurance | OPD | Paid time off | Training and developmentSenior-level Full TimePakistan - Remote R23d ago
-
Comprehensive Rehab Consultants USD 143K-190KAPIs | Azure ML | CI/CD | Databricks | Drift DetectionMid-level Full TimeKarachi, PK - Remote R25d ago
-
Senior AI Engineer USD 130K-185KAWS | Amazon Redshift | Apache Airflow | Apache Kafka | Apache SparkSenior-level Full TimeLahore, Pakistan25d ago
-
AWS | Airflow | Azure | CI/CD | DagsterFlexible US business hours | Remote workMid-level Full TimePakistan - Remote R26d ago
-
Senior Software Engineer - Data Engineering & AI USD 130K-204KAWS | Apache Airflow | Apache Spark | Azure | CI/CDSenior-level Full TimeIslamabad, Islamabad Capital Territory, Pakistan27d ago
-
Principal Data Engineer USD 126K-170KApache Delta | Apache Delta Lake | Apache Spark | Azure Blob | Azure Blob StorageSenior-level Full TimeLahore, Pakistan1mo ago
-
AI/ML Engineer USD 125K-198KAPI Integration | AWS IAM | AWS Lambda | Amazon Bedrock | Amazon S3Onsite work environmentSenior-level Full TimeLahore, Pakistan1mo ago
-
Associate AI Engineer USD 120K-171KAlgorithms | Artificial Intelligence | Data Structures | Deep learning | GitCareer growth | Company sponsored training | Company vehicle financing | Health coverage for family | In-house daycareMid-level Full TimeLahore, Pakistan1mo ago
-
Sr Finance and Workflow Automation Lead (AI-Driven) USD 151K-200KAPI Integration | Anomaly Detection | Artificial Intelligence | Budgeting | Data VisualizationSenior-level Full TimeLahore, Pakistan1mo ago
-
Staff Data Engineer - (.NET / Angular / PostgresSQL) USD 135K-199KAgile | Amazon Redshift | Angular | Azure Synapse | Azure Synapse AnalyticsSenior-level Full TimeLahore, Karachi, Islamabad1mo ago
-
Senior AI Agent Engineer USD 140K-204KAgent systems | Agentic Systems | Authentication | Authorization | CI/CDAmazing work culture | Free Lunch Facility | Fuel allowance | Group life insurance | Gym membershipSenior-level Full TimeIslamabad, Islamabad Capital Territory, Pakistan1mo ago