Big Data Engineer
Tasks
- Design batch and real-time data pipelines
- Develop distributed data processing solutions
- Document data processes and architectures
- Ensure data governance security and quality
- Implement streaming pipelines
- Ingest and transform enterprise data
- Manage Hadoop HDFS storage
- Monitor and troubleshoot data workflows
- Optimize performance, scalability, and reliability
- Orchestrate ETL workflows
- Use Hive and Impala for analytics
Perks/Benefits
- N/A
Skills/Tech-stack
Apache Hadoop | Apache Hive | Apache Impala | Apache Kafka | Apache NiFi | Apache Spark | CI/CD | Cloudera Data Platform | Data Governance | Data Modeling | Data Quality | Data Warehousing | Data platform | Distributed Computing | Docker | ETL | HDFS | Java | Kubernetes | Performance Tuning | PySpark | Python | SQL | Scala
Education
Roles
Related jobs
-
Analytics Cloud | Business Data Cloud | Data cloud | Data integration | ETLLearning and developmentExecutive-level Full TimeLahore, Pakistan1d ago
-
AI QA Testing Engineer USD 70K-98KAPI Testing | Conversation Testing | Intent Recognition | Language Processing | Natural LanguageCareer growth opportunities | Employee Old Age Benefits | Employee Wellness Initiatives | Learning and development programs | Life insuranceMid-level Full TimeLahore, Pakistan1d ago
-
Senior-level Full TimePakistan3d ago
-
Celery | Docker | Embeddings | FastAPI | HuggingfaceHybrid work | Monday to Saturday schedule | Onsite workSenior-level Full TimeIslamabad, Pakistan4d ago
-
Data Engineer USD 105K-130KAWS S3 | Amazon EMR | Apache Hive | Apache Hudi | Apache KafkaCareer growth | Company-sponsored trainings | Company-sponsored vehicle financing | Family health coverage | Healthcare coverageMid-level Full TimeLahore, Pakistan5d ago
-
Senior Machine Learning Engineer USD 125K-190KAWS | Airflow | Apache Spark | Azure | Cloud platformCareer growth opportunities | Collaborative work environment | Exposure to cutting edge AI and machine learning technologies | Innovation driven work environmentSenior-level Full TimeLahore, Punjab6d ago
-
AI Engineer - AI/LLM (Backend) | Pakistan USD 122K-184KAPI Design | AWS | Anthropic API | Backend Development | ChromaCollaborative low bureaucracy environment | Exposure to cutting edge AI and automation technologies | Own internal productSenior-level Full TimeIslamabad, Islamabad Capital Territory, Pakistan6d ago
-
AI Engineer (LangGraph / LangChain Ecosystem) INR 2000K-3900KAI Services | AI monitoring | App Services | Azure AI | Azure AI ServicesSenior-level Full TimeIslamabad, Federal Teritory6d ago
-
Expert Growth & Analytics USD 141K-190KA/B | A/B Testing | Appsflyer | B testing | Cohort AnalysisContinuous learning and development | Customer obsession culture | Inclusive workplace | Professional cultureSenior-level Full TimeIslamabad, Islamabad Capital Territory, Pakistan7d ago
-
Mid-level Full TimeIslamabad, Federal Teritory8d ago
-
Senior Software Engineer (AI/ML) INR 2000K-4750KAPI Integration | AWS | Amazon SageMaker | Asynchronous systems | CI/CDAdvance salaries | Entertainment activities | Gym facility | Interest Free Loan Facility | Medical Inpatient FacilitySenior-level Full TimeLahore, Punjab, Pakistan8d ago
-
Part-Time AI Engineers USD 130K-180KArtificial Intelligence | Debugging | Python | ReactFlexible hours | Part-time employment | Remote collaborationMid-level Part TimePakistan - Remote R8d ago
-
Bash | Data Pipelines | Data Processing | Docker | GCPMid-level Full TimeIslamabad, Pakistan8d ago
-
Senior Analytics Engineer CAD 115K-126KAttribution Modeling | BigQuery | Campaign tracking | Cohort Analysis | DashboardingFamily health insurance | Meals provided | On-site fitness facilities | Paid time off | Work-life balanceSenior-level Full TimeRawalpindi, Punjab, Pakistan9d ago
-
Expert Software Engineer USD 106K-154KASN 1 | Alerting | Automation | Cause analysis | Data DeduplicationMid-level Full TimeLahore, Punjab, Pakistan11d ago
-
API | AWS | Agile | Artificial Intelligence | AzureMonday to Friday | Onsite work | Work hours 9 AM to 6 PMSenior-level Full TimeLahore, Pakistan11d ago
-
APIs | Agile | Application Programming | Application Programming Interfaces | AutomationSenior-level Full TimeLahore, Pakistan11d ago
-
QA Automation Engineer - AI Driven INR 1750K-3000KAWS | Appium | Azure | CI/CD | CircleCIDaily lunch | Family health insurance | In-house gym | Paid time off | Work-life balanceSenior-level Full TimeRawalpindi, Punjab, Pakistan14d ago
-
AWS CloudFormation | Amazon Kinesis | Apache Airflow | BigQuery | CI/CDFully remote | Growth opportunities | U.S. business hoursMid-level Full TimePakistan - Remote R14d ago
-
Data Engineer USD 122K-152KAWS | Airflow | Amazon Redshift | Apache Spark | AzureFull-time employment | Onsite workSenior-level Full TimeIslamabad, Federal Teritory15d ago
-
Senior Software Engineer - AI/ML USD 143K-228KAWS | Azure | Computer Vision | Databricks | Deep learningSenior-level Full TimeLahore, Punjab, Pakistan17d ago
-
Associate Team Lead- Data Engineer INR 1500K-3000KAWS Glue | AWS Redshift | Amazon Web Services | Apache Airflow | AzureSenior-level Full TimeLahore, Punjab, Pakistan18d ago
-
Senior Data Engineer USD 165K-216KAccess Control | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageCompetitive benefits | Hybrid work environmentSenior-level Full TimeKarachi/Lahore/Islamabad19d ago
-
Full Stack Developer - BI & Data Engineering USD 119K-172K.NET | Android | Angular | CSS | Data ModelingContinuous learning opportunities | Forward looking leadership | Inclusive work environment | Open cultureMid-level Full TimeLahore, Punjab, Pakistan19d ago
-
Bash | Cloud infrastructure | Cloud platform | Data Processing | DockerAsynchronous culture | Friendly work environment | Inclusive workplace | Portfolio submission during application | Remote-friendlyMid-level Full TimeKarachi, Pakistan19d ago