Software Engineer, Data Infrastructure & Acquisition - Hyderabad, India
Tasks
- Build web crawler pipelines
- Collaborate with AI scientists on dataset roadmap
- Develop dataset collection workflows
- Extend ingestion pipeline infrastructure
- Find new audio data sources
- Ingest audio data into pipeline
- Manage infrastructure with Terraform
- Operate ingestion pipeline cloud infrastructure
- Shift cost throughput quality frontier
Perks/Benefits
- Asynchronous culture
- Career growth opportunities
- Friendly work environment
- Impactful product
- Remote/distributed work
Skills/Tech-stack
Bash | Cloud platform | Data Ingestion | Data Processing | Docker | Google Cloud | Google Cloud Platform | Large Scale Data | Large-scale | Large-scale Data Processing | Linux | Python | Terraform | Web Crawling
Education
Roles
Related jobs
-
Staff Machine Learning Engineer INR 3000K-4500KAPIs | Agentic Workflows | Airflow | Anomaly Detection | Bias detectionAgile work environment | Collaborative culture | In-office three days weeklySenior-level Full TimeBangalore R20h ago
-
AI Observability | AWS | Azure | CI/CD | DockerCareer advancement | Flexible work environment | Fully remote | Professional development | Work-life balanceSenior-level Full TimeIndia R20h ago
-
Senior-level Full TimeIndia21h ago
-
API Testing | Apache Airflow | Azure | Bitbucket | CI/CDEmployee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Volunteer time offSenior-level Full TimeChennai, TN, India21h ago
-
Senior-level Full TimeIN-TN-Chennai22h ago
-
Senior Data Engineer INR 1500K-2500KAlerting | Apache Pinot | BigQuery | Cloud platform | Cost OptimizationSenior-level Full TimeBangalore, India23h ago
-
Senior Manager - C2 INR 3000K-5000KAI Observability | Docker | Embedding Models | Evaluation | Generative AISenior-level Full TimeGurugram, Haryana, India23h ago
-
Java Full Stack Engineer - Professional INR 1300K-2200KAmazon Web Services | Apache Kafka | AppDynamics | Automation | Cause analysisClient office work requirement | Hybrid work modelMid-level Full TimeIndia R1d ago
-
Executive-level Full TimeMumbai, Maharashtra, India1d ago
-
Senior Data Engineer INR 1500K-2500KAWS | Amazon EMR | Amazon Redshift | Amazon S3 | Apache AirflowSenior-level Full TimePune1d ago
-
GenAI Engineer INR 1200K-2500KAWS | Artificial neural networks | Azure | Data Structures | DatabricksMid-level Full TimeIndia1d ago
-
Bootloader | C# | CAN | Configuration Management | DebuggingFlexi benefits | Health insurance | Hybrid working model | Internal job rotation | Life insuranceEntry-level Full TimeBangalore, IN1d ago
-
Senior Staff Engineer, Machine Learning Platform INR 3000K-5000KAirflow | Apache Hadoop | Apache Kafka | Apache Spark | CI/CDSenior-level Full TimePune, IN1d ago
-
Assistant Manager INR 1200K-2000KAPI Integration | CI/CD | Data Engineering | Data Governance | Data QualityMid-level Full TimeGurugram, Haryana, India1d ago
-
Platform Engineer INR 1600K-2500KAWS | Alerting | ArgoCD | Autoscaling | AzureBenefits package | Equal opportunity employment | On-call rotationsMid-level Full TimeIndia - Bengaluru1d ago
-
Business Intelligence Data Analytics Engineer INR 1500K-2500KData Modeling | Data Transformation | Data pipeline | Fivetran | GitSenior-level Full TimeHyderabad India1d ago
-
Executive-level Full TimeBangalore, Karnataka, India1d ago
-
Senior-level Full TimeBengaluru, Karnataka, India1d ago
-
Data Platform Engineer INR 3000K-4000KAWS EKS | AWS IAM | AWS SNS | AWS SQS | Amazon KinesisChildcare services | Employee assistance program | Employee doctor consultation access | Life assurance | Medical insuranceSenior-level Full TimeBengaluru, Karnataka, India1d ago
-
Data Ops Engineer INR 3000K-4000KAWS | Amazon Kinesis | Apache Airflow | Cloud platform | DBTChildcare services | Discretionary bonus | Doctor consultation access | Employee assistance program | Health insuranceSenior-level Full TimeBengaluru, Karnataka, India1d ago
-
Senior Data Tester INR 1632K-2800KApache Spark | Bitbucket | CI/CD | Checkmarx | ClouderaHybrid work environmentSenior-level Full TimeIndia - Pune1d ago
-
Senior Data Integration Engineer I INR 3264K-4401KAWS IAM | Airflow | Amazon VPC | Apache Flink | Apache SparkSenior-level Full TimeBengaluru1d ago
-
API Development | Agent systems | Backend Development | CI/CD | Cloud PlatformsAI experimentation focus | Career growth | Exposure to global enterprise clients | Inclusive collaborative culture | Innovation and learningSenior-level Full TimeIndia1d ago
-
Senior Data Engineer I INR 2500K-3380KAgile | Apache Airflow | Apache Hadoop | Apache Hive | Apache KafkaInclusive culture | Professional development time | Supportive team environment | Work-life balanceSenior-level Full TimeGurugram, HR, India1d ago
-
Data Engineer INR 1340K-1680KAWS | Azure | ClickHouse | DBT | Data ArchitectureDonation matching | Flexible PTO | Flexible schedule | Health insurance | Lunch stipendMid-level Full TimeBengaluru, Karnataka, India1d ago