Big Data Engineer
Islamabad, Federal Teritory
INR 1500K-2500K (estimate) Mid-level Full Time
Tasks
- Build ETL data ingestion pipelines
- Design batch data pipelines
- Design real-time streaming pipelines
- Develop Hive and Impala queries
- Develop distributed data processing systems
- Document data processes and workflows
- Ensure data governance security and data quality
- Implement Kafka streaming pipelines
- Ingest, transform, and integrate data
- Manage HDFS storage
- Monitor and troubleshoot data workflows
- Optimize pipeline performance and scalability
- Orchestrate ETL workflows
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | Apache Hadoop | Apache Hive | Apache Impala | Apache Kafka | Apache NiFi | Apache Spark | Azure | CI/CD | Cloud platform | Data Governance | Data Modeling | Data Quality | Data Security | Data Warehousing | Distributed Computing | Docker | ETL | Event Driven | Event-driven architecture | Google Cloud | Google Cloud Platform | HDFS | Java | Kubernetes | Parallel processing | PySpark | Python | Real Time | Real-time analytics | SQL | Scala
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
Related jobs
-
AWS | Airflow | Azure | CI/CD | DagsterFlexible US business hours | Remote workMid-level Full TimePakistan - Remote R18h ago
-
Big Data Engineer INR 1500K-2500KApache Hadoop | Apache Hive | Apache Impala | Apache Kafka | Apache NiFiMid-level Full TimeKarachi, Sindh18h ago
-
Analytics Cloud | Business Data Cloud | Data Modeling | Data Quality | Data ValidationLearning and development opportunitiesExecutive-level Full TimeLahore, Pakistan1d ago
-
AWS | Analytics Cloud | Azure | BW Bridge | Data GovernanceSenior-level Full TimeLahore, Pakistan1d ago
-
AI/ML | Azure Data | Azure Data Factory | Azure Data Lake | Azure SynapseSenior-level Full TimeKarachi, Pakistan1d ago
-
AWS | Agent systems | Claude | ElevenLabs | Embedding ModelsAI tools allowance | Learning sessions | Performance bonusesSenior-level Full TimeKarachi, Pakistan1d ago
-
AWS CloudFormation | AWS Glue | Amazon Kinesis | Amazon Redshift | Apache AirflowFlexible U.S. business hours | Fully remoteMid-level Full TimePakistan - Remote R1d ago
-
AI Agents | API Integration | Anomaly Detection | Artificial Intelligence | Data VisualizationSenior-level Full TimeLahore, Pakistan2d ago
-
AKS | ARM Templates | Active Directory | Audit Logging | Azure Active DirectorySenior-level Full TimeKarachi, Lahore, Islamabad2d ago
-
Senior-level Full TimeKarachi, Pakistan3d ago
-
AI/ML Engineer CAD 105K-115KAPI Integration | Automation | JavaScript | LLM integration | Language ModelsCareer growth | Flexible schedule | Remote workMid-level Full TimeIslamabad, Pakistan R3d ago
-
DevOps Engineer USD 100K-141KAWS CloudFormation | Amazon Web Services | Ansible | Azure | BashFlexible working hours | Health insurance | Life insurance | Paid certifications | Paid time offMid-level Full TimeLahore, Punjab, Pakistan - Remote R3d ago
-
Database Developer / Data Engineer USD 120K-150KAWS | Apache Spark | Data Analysis | Data Modeling | Data WarehousingSenior-level Full TimeLahore, PK3d ago
-
Principal Software Consultant - AI/ML Engineer USD 165K-220KAKS | API Integration | AWS | Artificial Intelligence | AzureSenior-level Full TimeLahore, Karachi, Islamabad3d ago
-
Senior Software Consultant - Agentic AI - Morning Shift INR 2000K-4150KAI system evaluation | AI workflow | AI workflow design | AutoGPT | CrewAISenior-level Full TimeIslamabad3d ago
-
Technical Delivery Consultant (Data & Analytics) USD 138K-199KAgile | Amazon Redshift | Apache Airflow | Azure Data | Azure Data FactorySenior-level Full TimeIslamabad, Islamabad3d ago
-
Data Engineer CAD 73K-119KAPI pagination | Apache NiFi | Authentication | Bold BI | CSVChild care facility | Company lunch/dinner | Conveyance allowance | Friendly work environment | Home internet subsidyMid-level Full TimePER - Lahore, PK, Pakistan4d ago
-
AI-First Software Engineer USD 145K-200KAPIs | Automation | GitHub | Language Processing | Machine LearningHealth insurance | Leave encashment | Loan and advance salary | Maternity leaves | Paid time offMid-level Full TimeKarachi4d ago
-
Senior Data AI Engineer USD 165K-212KAWS | Amazon Redshift | Apache Airflow | Apache Kafka | Apache SparkSenior-level Full TimeLahore, Punjab, Pakistan4d ago
-
Senior AI Engineer USD 150K-245KAI gateway | Agent Frameworks | Agent systems | Cloud infrastructure | ContainerizationSenior-level Full TimeKarachi/ Lahore5d ago
-
Associate Software Engineer - Data+AI USD 138K-211KAPIs | CI/CD | Cloud Platforms | Data Pipelines | Data StructuresMid-level Full TimeLahore, Punjab, Pakistan5d ago
-
Senior Software Engineer - AI, Data & Backend Systems USD 145K-206KAWS | Airflow | Amazon Kinesis | Apache Spark | AzureSenior-level Full TimeLahore, Punjab, Pakistan5d ago
-
Senior Computer Vision Engineer USD 152K-287K3D Point Clouds | 3D Vision | C++ | CUDA | CUDNNCollaborative work environment | Growth opportunities | Real world use case exposureSenior-level Full TimePakistan6d ago
-
Bash | Data Processing | Docker | GCP | LinuxAsynchronous culture | Competitive salary | Flexible remote work | Friendly atmosphere | High impact productMid-level Full TimeLahore, Pakistan6d ago
-
Azure Data Engineer USD 119K-165KAzure Data | Azure Data Factory | Azure Data Lake | Azure SQL | Azure SQL DatabaseSenior-level Full TimeIslamabad, Islamabad Territory6d ago