Data Engineer
Tasks
- Automate deployments with CI/CD
- Build ETL/ELT pipelines
- Containerize data services
- Design analytics optimized schemas
- Develop and monitor streaming pipelines
- Document data models and pipelines
- Enforce data naming conventions
- Ensure GDPR compliance
- Ensure HIPAA compliance
- Ensure low latency ingestion
- Implement data validation checks
- Implement partitioning and clustering
- Ingest structured and unstructured data
- Maintain data lineage and documentation
- Manage data warehouses
- Manage infrastructure with Terraform or CloudFormation
- Monitor pipeline health and resolve failures
- Optimize SQL queries
- Orchestrate containers in Kubernetes
- Orchestrate data workflows
- Set up anomaly detection and logging
- Support BI teams with curated datasets
- Tune query performance
Perks/Benefits
Skills/Tech-stack
AWS CloudFormation | Airflow | Amazon Kinesis | Amazon Redshift | BigQuery | CI/CD | Clustering | DBT | Dagster | Docker | ELT | ETL | GDPR | GitHub Actions | GitLab CI | Google Pubsub | Great Expectations | HIPAA | Jenkins | Kafka | Kubernetes | Looker | Luigi | Partitioning | Power BI | Prefect | Python | SQL | Scala | Snowflake | Snowflake Schema | Star Schema | Tableau | Terraform
Education
N/A
Roles
Related jobs
-
AI | API | Airtable | Automation | Google SheetsFlexible work hours | Remote workMid-level Full TimePakistan - Remote R13h ago
-
API rate-limiting | Access Control | Airflow | Amazon Redshift | BigQueryRemote workSenior-level Full TimePakistan - Remote R5d ago
-
Alerting | Apache Airflow | Cloud Composer | Cloud Functions | Cloud StorageRemote-first work environmentSenior-level Full TimePakistan R6d ago
-
APIs | Amazon Web Services | Azure | Cloud deployment | Data PipelinesFull-time employment | Remote workSenior-level Full TimePakistan R17d ago
-
Mid-level Full TimePakistan - Remote R17d ago
-
Azure AI (Agentic) Specialist - Team Lead USD 122K-200KAI Document Intelligence | AI Search | AI Studio | Agent systems | Agentic AIHybrid work model | Team lead responsibilitiesSenior-level Full TimePakistan - Remote R21d ago
-
Azure AI (Agentic) Specialist - Team Lead USD 122K-200KAI Document Intelligence | AI Search | AI Studio | Agent systems | Agentic AIHybrid work model | Team leadershipSenior-level Full TimePakistan - Remote R21d ago
-
Azure AI (Agentic) Specialist - Team Lead USD 122K-200KAI Document Intelligence | AI Search | AI Studio | Agent systems | Agentic AIHybrid work | Team leadershipSenior-level Full TimePakistan - Remote R21d ago
-
Backend AI & Data Pipeline Engineer USD 70K-98KAWS Fargate | AWS Lambda | AWS Step Functions | Amazon Bedrock | Amazon ECSFlexible working hours | Fully remote | Hands-on engineering experience | Long-term progression | Opportunity to build real product impactEntry-level Full Time InternshipIslamabad, Islamabad Capital Territory, Pakistan R25d ago
-
AWS Bedrock | AWS EC2 | AWS ECS | Amazon S3 | Anomaly DetectionRemote work | VPN AccessSenior-level Full TimeLahore, Pakistan R28d ago
-
AI Engineer USD 130K-195KAsynchronous programming | Background tasks | Batching | Caching | Content FilteringAnnual company retreat | Exposure in AI | Fitness reimbursements | Global team experience | Health insuranceMid-level Full TimePakistan - Remote R29d ago
-
Data Engineer USD 135K-165KAzure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure SynapseHealth insurance | Paid time off | Training and development | Work from homeSenior-level Full TimePakistan - Remote R30d ago
-
Applied AI Engineer (Automation) USD 150K-220KAPIs | AWS | Amazon Bedrock | Asynchronous programming | AzureFull-time | Remote workSenior-level ContractPakistan - Remote R1mo ago
-
Senior Data Engineer INR 2000K-2000KACID transactions | Airflow | Apache Spark | Automated testing | BackfillingFull-time employment | Hybrid workSenior-level Full TimePakistan - Remote R1mo ago
-
Senior Computer Vision Engineer USD 165K-240KC++ | Deep learning | Image Processing | Keras | Machine LearningHealth insurance | OPD | Paid time off | Training and developmentSenior-level Full TimePakistan - Remote R1mo ago
-
AI tools | APIs | Automation tools | Data Pipelines | IntegrationsFast-moving environment | Global compensation | Mentorship | Ownership | Real business systemsEntry-level Full TimeLahore, Pakistan R1mo ago
-
Infrastructure Engineer (Data) EUR 40K-66KAnsible | Bash | Cassandra | Kafka | KubernetesGrowth opportunities | Learning opportunities | Remote workMid-level Full TimePakistan; India; Slovakia; Columbia; Brazil; Argentina; … R1mo ago
-
DevOps Engineer USD 125K-185KAnsible | ArgoCD | Bash | Cloud Computing | DevOpsFull-time | Remote workSenior-level ContractPakistan - Remote R1mo ago