Software Engineer, Data Infrastructure & Acquisition - Hyderabad, India
Tasks
- Build web crawler pipelines
- Collaborate with AI scientists on dataset roadmap
- Develop dataset collection workflows
- Extend ingestion pipeline infrastructure
- Find new audio data sources
- Ingest audio data into pipeline
- Manage infrastructure with Terraform
- Operate ingestion pipeline cloud infrastructure
- Shift cost throughput quality frontier
Perks/Benefits
- Asynchronous culture
- Career growth opportunities
- Friendly work environment
- Impactful product
- Remote/distributed work
Skills/Tech-stack
Bash | Cloud platform | Data Ingestion | Data Processing | Docker | Google Cloud | Google Cloud Platform | Large Scale Data | Large-scale | Large-scale Data Processing | Linux | Python | Terraform | Web Crawling
Education
Roles
Related jobs
-
AI Observability | AWS | Azure | CI/CD | DockerCareer advancement | Flexible work environment | Fully remote | Professional development | Work-life balanceSenior-level Full TimeIndia R19h ago
-
Senior-level Full TimeIndia20h ago
-
API Testing | Apache Airflow | Azure | Bitbucket | CI/CDEmployee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Volunteer time offSenior-level Full TimeChennai, TN, India20h ago
-
Senior-level Full TimeIN-TN-Chennai20h ago
-
Senior Data Engineer INR 1500K-2500KAlerting | Apache Pinot | BigQuery | Cloud platform | Cost OptimizationSenior-level Full TimeBangalore, India21h ago
-
Senior Manager - C2 INR 3000K-5000KAI Observability | Docker | Embedding Models | Evaluation | Generative AISenior-level Full TimeGurugram, Haryana, India22h ago
-
Java Full Stack Engineer - Professional INR 1300K-2200KAmazon Web Services | Apache Kafka | AppDynamics | Automation | Cause analysisClient office work requirement | Hybrid work modelMid-level Full TimeIndia R22h ago
-
Executive-level Full TimeMumbai, Maharashtra, India22h ago
-
Senior Data Engineer INR 1500K-2500KAWS | Amazon EMR | Amazon Redshift | Amazon S3 | Apache AirflowSenior-level Full TimePune23h ago
-
GenAI Engineer INR 1200K-2500KAWS | Artificial neural networks | Azure | Data Structures | DatabricksMid-level Full TimeIndia1d ago
-
Bootloader | C# | CAN | Configuration Management | DebuggingFlexi benefits | Health insurance | Hybrid working model | Internal job rotation | Life insuranceEntry-level Full TimeBangalore, IN1d ago
-
Assistant Manager INR 1200K-2000KAPI Integration | CI/CD | Data Engineering | Data Governance | Data QualityMid-level Full TimeGurugram, Haryana, India1d ago
-
Business Intelligence Data Analytics Engineer INR 1500K-2500KData Modeling | Data Transformation | Data pipeline | Fivetran | GitSenior-level Full TimeHyderabad India1d ago
-
Executive-level Full TimeBangalore, Karnataka, India1d ago
-
Data Platform Engineer INR 3000K-4000KAWS EKS | AWS IAM | AWS SNS | AWS SQS | Amazon KinesisChildcare services | Employee assistance program | Employee doctor consultation access | Life assurance | Medical insuranceSenior-level Full TimeBengaluru, Karnataka, India1d ago
-
Senior Data Tester INR 1632K-2800KApache Spark | Bitbucket | CI/CD | Checkmarx | ClouderaHybrid work environmentSenior-level Full TimeIndia - Pune1d ago
-
Senior Data Integration Engineer I INR 3264K-4401KAWS IAM | Airflow | Amazon VPC | Apache Flink | Apache SparkSenior-level Full TimeBengaluru1d ago
-
API Development | Agent systems | Backend Development | CI/CD | Cloud PlatformsAI experimentation focus | Career growth | Exposure to global enterprise clients | Inclusive collaborative culture | Innovation and learningSenior-level Full TimeIndia1d ago
-
Senior Data Engineer I INR 2500K-3380KAgile | Apache Airflow | Apache Hadoop | Apache Hive | Apache KafkaInclusive culture | Professional development time | Supportive team environment | Work-life balanceSenior-level Full TimeGurugram, HR, India1d ago
-
Data Engineer INR 1340K-1680KAWS | Azure | ClickHouse | DBT | Data ArchitectureDonation matching | Flexible PTO | Flexible schedule | Health insurance | Lunch stipendMid-level Full TimeBengaluru, Karnataka, India1d ago
-
Senior Analyst-Data Science INR 2500K-4400KA/B | A/B Testing | B testing | Causal Inference | Data PreparationSenior-level Full TimeGurugram, HR, India1d ago
-
Bash | Cloud platform | Data Processing | Docker | Google CloudAsynchronous culture | Diverse and inclusive workplace | Laid-back atmosphere | Opportunity to make impact | Remote first 100 percent distributed environmentMid-level Full TimeChennai, India1d ago
-
Bash | Cloud platform | Data Ingestion | Data Processing | DockerAsynchronous work culture | Friendly laid-back atmosphere | Inclusive workplace | Opportunity to build impactful productMid-level Full TimeKochi, India1d ago
-
IN_Associate_AI Engineer_GCC_Advisory_Hyderabad INR 2500K-4800KAPI Development | Anthropic API | Async Programming | Autogen | CI/CDFlexibility programmes | Inclusive benefits | Mentorship | Wellbeing supportSenior-level Full TimeHyderabad - Salarpuria, India1d ago
-
Data Engineer (SQL + Python/Java) INR 700K-1500KAWS EMR | Agile Scrum | Amazon Web Services | Apache Spark | Continuous DeliveryHybrid work flexibility | Remote work supportMid-level Full TimeGurgaon - Cyber Park, India1d ago