Data Engineer
Tasks
- Automate deployments with CI/CD
- Build ETL/ELT pipelines
- Containerize data services
- Design analytics schemas
- Detect anomalies
- Develop streaming pipelines
- Document data models and pipelines
- Enforce naming conventions
- Implement partitioning and clustering
- Ingest structured and unstructured data
- Log data quality checks
- Maintain lineage tracking and documentation
- Manage data warehouses
- Monitor low-latency data ingestion
- Orchestrate data workflows
- Orchestrate in Kubernetes
- Provision cloud infrastructure
- Support BI dashboard development
- Tune SQL and query performance
- Validate data quality
Perks/Benefits
- N/A
Skills/Tech-stack
AWS Glue | Airflow | Azure Data | Azure Data Factory | BigQuery | CloudFormation | DBT | Dagster | Data Factory | Docker | ELT | ETL | GCP Dataflow | GDPR | GitHub Actions | GitLab CI | Great Expectations | HIPAA | Jenkins | Kafka | Kinesis | Kubernetes | Luigi | Prefect | Pub/Sub | Python | Redshift | SQL | Scala | Snowflake | Terraform
Education
N/A
Roles
Related jobs
-
Applied AI Engineer (Automation) USD 150K-220KAPIs | AWS | Amazon Bedrock | Asynchronous programming | AzureFull-time | Remote workSenior-level ContractPakistan - Remote R1d ago
-
Senior Data Engineer INR 2000K-2000KACID transactions | Airflow | Apache Spark | Automated testing | BackfillingFull-time employment | Hybrid workSenior-level Full TimePakistan - Remote R7d ago
-
Senior Computer Vision Engineer USD 165K-240KC++ | Deep learning | Image Processing | Keras | Machine LearningHealth insurance | OPD | Paid time off | Training and developmentSenior-level Full TimePakistan - Remote R11d ago
-
Mid-level Full TimeHybrid - Islamabad & Lahore; Pakistan … R13d ago
-
APIs | CI/CD | Cloud Data | Cloud Data Warehouses | Data PipelinesFlexible working hours | Remote workSenior-level Full TimePakistan - Remote R15d ago
-
AI tools | APIs | Automation tools | Data Pipelines | IntegrationsFast-moving environment | Global compensation | Mentorship | Ownership | Real business systemsEntry-level Full TimeLahore, Pakistan R16d ago
-
Infrastructure Engineer (Data) EUR 40K-66KAnsible | Bash | Cassandra | Kafka | KubernetesGrowth opportunities | Learning opportunities | Remote workMid-level Full TimePakistan; India; Slovakia; Columbia; Brazil; Argentina; … R20d ago
-
DevOps Engineer USD 125K-185KAnsible | ArgoCD | Bash | Cloud Computing | DevOpsFull-time | Remote workSenior-level ContractPakistan - Remote R22d ago
-
Sr. Databricks Azure Data Engineer USD 139K-237KApache Spark | Apache Spark internals | Azure DevOps | Azure Security | Azure ecosystemSenior-level ContractPakistan - Remote R1mo ago