Data Engineer
Tasks
- Build and maintain ETL/ELT pipelines
- Build real-time streaming pipelines
- Collaborate with analysts data scientists and BI teams
- Create curated datasets for analytics and machine learning
- Deploy services with Docker and Kubernetes
- Design and optimize cloud data warehouses
- Implement CI/CD workflows
- Implement data quality validation and anomaly detection
- Ingest data from APIs SaaS and databases
- Maintain documentation for pipelines schemas and workflows
- Manage cloud infrastructure with Infrastructure as Code
- Model star schemas and analytics ready data models
- Monitor pipeline health and failed jobs
- Optimize SQL query performance and partitioning
- Orchestrate workflows and automate retries alerting
- Set up logging and lineage tracking
Perks/Benefits
Skills/Tech-stack
AWS CloudFormation | AWS Glue | Amazon Kinesis | Amazon Redshift | Apache Airflow | Azure Data | Azure Data Factory | BigQuery | Cloud Pub/Sub | Clustering | DBT | Dagster | Data Factory | Data Governance | Data Lineage | Data Modeling | Data Quality | Data Warehousing | Docker | ELT | ETL | GCP Dataflow | GDPR | GitHub Actions | GitLab CI | Google Cloud | Google Cloud Pub/Sub | Great Expectations | HIPAA | Jenkins | Kafka | Kubernetes | Luigi | Partitioning | Prefect | Pub/Sub | Python | SQL | Scala | Snowflake | Streaming Analytics | Terraform
Education
N/A
Roles
Related jobs
-
AWS | Airflow | Azure | CI/CD | DagsterFlexible US business hours | Remote workMid-level Full TimePakistan - Remote R16h ago
-
AI/ML Engineer CAD 105K-115KAPI Integration | Automation | JavaScript | LLM integration | Language ModelsCareer growth | Flexible schedule | Remote workMid-level Full TimeIslamabad, Pakistan R3d ago
-
DevOps Engineer USD 100K-141KAWS CloudFormation | Amazon Web Services | Ansible | Azure | BashFlexible working hours | Health insurance | Life insurance | Paid certifications | Paid time offMid-level Full TimeLahore, Punjab, Pakistan - Remote R3d ago
-
Apache Spark | Azure Data | Azure Data Factory | Azure Data Lake | Data FactoryRemote workSenior-level Full TimeLahore, Pakistan R7d ago
-
Backend AI & Data Pipeline Engineer USD 90K-120KAWS EventBridge | AWS Lambda | AWS Step Functions | Amazon Bedrock | Amazon ECSFlexible working hours | Fully remote | Professional growthEntry-level Full Time InternshipIslamabad, Islamabad Capital Territory, Pakistan R7d ago
-
API Integration | Automation | Embeddings | JavaScript | Language ModelsAutonomy | Exposure to international clients | Flexible remote work | High ownership | Opportunity for Ongoing WorkSenior-level Full TimePakistan - Remote R17d ago
-
API Integration | Architecture | Data Modeling | Data Pipelines | DatabasesFull-time | Long term role | Remote workSenior-level Full TimePakistan R18d ago
-
Alerting | Apache Airflow | Cloud Composer | Cloud Functions | Cloud StorageRemote-first work environmentSenior-level Full TimePakistan R24d ago
-
APIs | Amazon Web Services | Azure | Cloud deployment | Data PipelinesFull-time employment | Remote workSenior-level Full TimePakistan R1mo ago
-
Mid-level Full TimePakistan - Remote R1mo ago
-
Azure AI (Agentic) Specialist - Team Lead USD 122K-200KAI Document Intelligence | AI Search | AI Studio | Agent systems | Agentic AIHybrid work model | Team lead responsibilitiesSenior-level Full TimePakistan - Remote R1mo ago
-
Azure AI (Agentic) Specialist - Team Lead USD 122K-200KAI Document Intelligence | AI Search | AI Studio | Agent systems | Agentic AIHybrid work model | Team leadershipSenior-level Full TimePakistan - Remote R1mo ago
-
Azure AI (Agentic) Specialist - Team Lead USD 122K-200KAI Document Intelligence | AI Search | AI Studio | Agent systems | Agentic AIHybrid work | Team leadershipSenior-level Full TimePakistan - Remote R1mo ago
-
Backend AI & Data Pipeline Engineer USD 70K-98KAWS Fargate | AWS Lambda | AWS Step Functions | Amazon Bedrock | Amazon ECSFlexible working hours | Fully remote | Hands-on engineering experience | Long-term progression | Opportunity to build real product impactEntry-level Full Time InternshipIslamabad, Islamabad Capital Territory, Pakistan R1mo ago
-
AWS Bedrock | AWS EC2 | AWS ECS | Amazon S3 | Anomaly DetectionRemote work | VPN AccessSenior-level Full TimeLahore, Pakistan R1mo ago
-
AI Engineer USD 130K-195KAsynchronous programming | Background tasks | Batching | Caching | Content FilteringAnnual company retreat | Exposure in AI | Fitness reimbursements | Global team experience | Health insuranceMid-level Full TimePakistan - Remote R1mo ago
-
Data Engineer USD 135K-165KAzure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure SynapseHealth insurance | Paid time off | Training and development | Work from homeSenior-level Full TimePakistan - Remote R1mo ago
-
Applied AI Engineer (Automation) USD 150K-220KAPIs | AWS | Amazon Bedrock | Asynchronous programming | AzureFull-time | Remote workSenior-level ContractPakistan - Remote R1mo ago