Lead Data Engineer (AWS Data Platform)
Tasks
- Build enterprise data warehouse solutions
- Collaborate with stakeholders to define data requirements
- Create technical documentation and operational procedures
- Design data pipelines
- Develop ETL and ELT processes
- Ensure data quality, integrity, security, and governance
- Monitor data pipelines and automate performance improvements
- Optimize data ingestion transformation and processing
- Perform code reviews and technical design discussions
- Perform performance tuning for Spark ETL and Redshift
- Troubleshoot production data incidents and perform root cause analysis
- Write complex SQL queries and stored procedures
Perks/Benefits
Skills/Tech-stack
AWS Glue | Agile | Amazon EMR | Amazon Redshift | CI/CD | Data Governance | Data Modeling | Data Quality | Data Security | Data Warehousing | DevOps | Dimensional Modeling | ELT | ETL | Performance Tuning | PySpark | Python | SQL | Stored Procedures | Workflow Orchestration
Education
Roles
Data Engineer | Engineer | Lead | Lead Data | Lead Data Engineer
Related jobs
-
Analytics Cloud | Business Data Cloud | Data cloud | Data integration | ETLLearning and development opportunitiesExecutive-level Full TimeLahore, Pakistan1d ago
-
Bash | Cloud platform | Data Processing | Docker | GCPAsynchronous culture | Friendly work environment | Opportunity to work on impactful product | Remote work environmentMid-level Full TimeIslamabad, Pakistan1d ago
-
API | JSON | Java | JavaScript | PythonOpportunity to work on AI projects | Remote workMid-level ContractIndia; Pakistan; Nigeria; Kenya; Egypt; Ghana; … R2d ago
-
AI Solution Engineer (Agentic & Prompt) INR 2000K-5000KAssistants API | ELT | ETL | FastAPI | FlaskMid-level Full TimeLahore, Pakistan3d ago
-
Senior Software Engineer, Dev USD 108K-170KAPI Integration | Authentication | Conversational AI | Function Calling | GitSenior-level Full TimeLahore (Ibex 2)8d ago
-
Apache Airflow | Apache Spark | Batch Processing | Data Governance | Data ModelingCareer growth | Full-time contract | Remote-first work environmentSenior-level Contract Full TimePakistan R9d ago
-
Senior Data Engineer USD 119K-258KApache Spark | Azure Data | Azure Data Factory | Azure Synapse | Azure Synapse AnalyticsSenior-level Full TimeLahore, Pakistan10d ago
-
Principle AI Solutions Engineer CAD 103K-141KAPI Integration | Agentic Workflows | Artificial Intelligence | Autogen | Autonomous AgentsCareer growth opportunities | Collaborative culture | Supportive work environmentMid-level Full TimeLahore, Pakistan10d ago
-
Mid-level Full TimeLahore - Punjab - Pakistan11d ago
-
Bash | Cloud platform | Data Ingestion | Data Ingestion Pipelines | Data ProcessingAsynchronous culture | Competitive salary | Friendly work atmosphere | Opportunity to make impactMid-level Full TimeKarachi, Pakistan11d ago
-
Azure AI Engineer - Pakistan INR 1200K-2500KAI Services | ARM | Agile | App Service | Application InsightsMid-level Full TimeIslamabad, Pakistan12d ago
-
Principal AI Engineer INR 3600K-4972KAI Agents | AI Services | Azure AI | Azure AI Services | Azure DevOpsSenior-level Full TimeKarachi, Pakistan, Pakistan13d ago
-
Senior-level Full TimeIslamabad, Pakistan, Pakistan13d ago
-
ARM | Azure | Azure Blob | Azure Blob Storage | Azure DataMid-level Full TimeKarachi, Pakistan R17d ago
-
Data Engineer INR 2000K-2500KAzure | Azure Data | Azure Data Factory | Data Factory | Data ModelingChild care facility | Conveyance allowance | Home internet subsidy | Leave encashment | Life benefitMid-level Full TimePER - Lahore, PK, Pakistan18d ago
-
Principal AI Engineer INR 2250K-5000KAPI | Agentic development | Fine Tuning | Generative AI | LangchainOn site project support | Travel for client workshopsSenior-level Full TimeLahore, Pakistan19d ago
-
Associate Team Lead- Data Engineer USD 125K-165KAWS | AWS Glue | Amazon Redshift | Apache Airflow | AzureSenior-level Full TimeLahore, Punjab, Pakistan19d ago
-
Amazon Kinesis | Amazon Redshift | Apache Airflow | BigQuery | CI/CDRemote work | U.S. business hoursSenior-level Full TimePakistan - Remote R20d ago
-
Senior Data Engineer INR 1500K-2500KAWS Glue | Apache Kafka | Apache Spark | Azure | Data ModelingHealth insurance | Life insurance | OPD | Paid time off | Training and developmentSenior-level Full TimePakistan - Remote R22d ago
-
AI Systems Engineer INR 1200K-2500KAPIs | Apps Script | Authentication | Authorization | Best practicesMid-level Full TimeKarachi, Pakistan23d ago
-
Comprehensive Rehab Consultants USD 143K-190KAPIs | Azure ML | CI/CD | Databricks | Drift DetectionMid-level Full TimeKarachi, PK - Remote R24d ago
-
Senior AI Engineer USD 130K-185KAWS | Amazon Redshift | Apache Airflow | Apache Kafka | Apache SparkSenior-level Full TimeLahore, Pakistan24d ago
-
AWS | Airflow | Azure | CI/CD | DagsterFlexible US business hours | Remote workMid-level Full TimePakistan - Remote R25d ago
-
Senior Software Engineer - Data Engineering & AI USD 130K-204KAWS | Apache Airflow | Apache Spark | Azure | CI/CDSenior-level Full TimeIslamabad, Islamabad Capital Territory, Pakistan26d ago
-
Principal Data Engineer USD 126K-170KApache Delta | Apache Delta Lake | Apache Spark | Azure Blob | Azure Blob StorageSenior-level Full TimeLahore, Pakistan1mo ago