Backend AI & Data Pipeline Engineer
Islamabad, Islamabad Capital Territory, Pakistan
USD 88K-100K (estimate) Entry-level Full Time Internship
Tasks
- Build and maintain knowledge graph
- Build resumable processing loops
- Design and maintain data processing pipelines
- Develop discovery and matching API
- Generate and manage semantic embeddings
- Implement vector retrieval and LLM re ranking
- Index embeddings in vector search
- Maintain and improve institution data scrapers
- Maintain and improve job scrapers
- Right size container infrastructure cost
Perks/Benefits
Skills/Tech-stack
AWS Lambda | AWS Step Functions | Amazon Bedrock | Association Rules | Async Processing | Atlas Vector Search | ECS | Elasticsearch | EventBridge | FP Growth | Fargate | HTML parsing | Knowledge graphs | LLM Re Ranking | Machine Learning | MongoDB | MongoDB Atlas | MongoDB Atlas Vector Search | Pandas | Python | Re-ranking | Semantic similarity | Spot instances | Step Functions | Text Cleaning | Titan v2 | Vector Search
Education
N/A
Related jobs
-
Data Engineer, Tech USD 100K-144KData Modeling | Data Quality | Data Warehousing | Database Indexing | ETLMid-level Full TimeLahore, Pakistan1d ago
-
Senior Data Engineer (AWS) USD 139K-209KAWS Glue | AWS Lambda | AWS VPC | Amazon RDS | Amazon RedshiftCollaborative team | Continuous improvement | Remote workSenior-level Full TimeLahore, Punjab4d ago
-
Senior Data Engineer (AWS) USD 139K-209KAWS Glue | AWS Lambda | AWS VPC | Amazon RDS | Amazon RedshiftRemote workSenior-level Full TimeKarachi, Sindh4d ago
-
AWS CloudFormation | AWS Glue | Amazon Kinesis | Amazon Redshift | Apache AirflowRemote workMid-level Full TimePakistan - Remote R5d ago
-
Senior Data Engineer (AWS / PLSQL / Oracle) INR 3750K-6250KAWS Lambda | Amazon Redshift | Amazon S3 | Amazon Web Services | Data ModelingHybrid workSenior-level Full TimeKarachi, Sindh5d ago
-
Lead Data Engineer (AWS / PLSQL / PL/PGSQL) INR 1500K-4000KAWS Glue | AWS Lambda | AWS Redshift | Amazon S3 | Amazon Web ServicesHybrid work | Technical leadershipSenior-level Full TimeIslamabad, Federal Capital5d ago
-
Lead Data Engineer (AWS / PLSQL / PL/PGSQL) INR 1500K-4000KAWS Glue | AWS Lambda | Amazon Redshift | Amazon S3 | CI/CDSenior-level Full TimeKarachi, Sindh5d ago
-
Senior Data Engineer (AWS / PLSQL / Oracle) INR 3750K-6250KAWS | AWS Lambda | AWS S3 | Amazon Redshift | Data ModelingHybrid workSenior-level Full TimeIslamabad, Federal Capital5d ago
-
Lead Data Engineer (AWS / PLSQL / PL/PGSQL) INR 1500K-4000KAWS Glue | AWS Lambda | Amazon Redshift | Amazon S3 | Amazon Web ServicesHybrid workSenior-level Full TimeLahore, Punjab5d ago
-
Mid-level Full TimeLahore, Punjab, Pakistan5d ago
-
AWS AI/ML Practice Lead CAD 146K-202KAPI Gateway | AWS API | AWS API Gateway | AWS CDK | AWS EventBridgeSenior-level Full TimeLahore, Punjab, Pakistan6d ago
-
Senior Data Engineer GBP 50K-70KApache Kafka | Azure | Azure Data | Azure Data Factory | Azure EventSenior-level Full TimeLahore, Pakistan7d ago
-
Application Programming | Application Programming Interfaces | Azure Data | Azure Data Factory | Azure SQLSenior-level Full TimeKarachi, Pakistan7d ago
-
Adobe Analytics | Apache Spark | Classification | Clickstream analysis | ClusteringMid-level Full TimePakistan7d ago
-
APIs | Amazon Web Services | Azure | Cloud deployment | Data PipelinesFull-time employment | Remote workSenior-level Full TimePakistan R7d ago
-
Mid-level Full TimePakistan - Remote R7d ago
-
AWS | Agent coordination | Airtable | Anthropic API | Business APIOnsite workMid-level Full TimeLahore, Pakistan8d ago
-
Mid-level Full TimeLahore, Pakistan8d ago
-
Senior AI/ML Engineer USD 128K-188KAI Services | API Integration | Azure AI | Azure AI Services | Azure OpenAIDiversity and inclusion | Full-time employment | Growth opportunities | Onsite workSenior-level Full TimeLahore, Pakistan10d ago
-
Adobe Analytics | Chatbots | Classification | Clickstream analytics | ClusteringMid-level Full TimePakistan10d ago
-
Access Control | Airflow | Amazon Redshift | BigQuery | CI/CDRemote work flexibilitySenior-level Full TimePakistan - Remote R10d ago
-
AI Search | Azure AI | Azure AI Search | Azure OpenAI | EmbeddingsSenior-level Full TimeKarachi, Lahore, Islamabad10d ago
-
Senior Software Consultant - MLOps - Morning Shift USD 150K-197KAmazon Web Services | Apache Airflow | Azure | CI/CD | Cloud ComputingSenior-level Full TimeIslamabad10d ago
-
Senior Software Consultant - Agentic AI - Morning Shift USD 146K-191KAI Workflow Orchestration | AI monitoring | AI system evaluation | AI workflow | AutoGPTSenior-level Full TimeIslamabad10d ago
-
Data Engineer CAD 80K-119KAWS | AWS EMR | AWS Glue | AWS KMS | Amazon AthenaBonuses | Child care facility | Company-provided meals | Conveyance allowance | Home internet subsidyMid-level Full TimePER - Karachi, PK, Pakistan10d ago