Data Engineer
Bangalore - Manyata Tech Park Road, India
INR 2000K-4064K (estimate) Senior-level Full Time
Tasks
- Build batch and real-time data pipelines
- Collaborate with data scientists and software engineers
- Develop Python data engineering frameworks
- Develop data models and data products
- Ensure data quality, reliability, and observability
- Implement CI/CD automation and Infrastructure as Code
- Implement data encryption in transit and at rest
- Ingest security telemetry data
- Integrate data solutions into enterprise security tools
- Manage distributed data processing
- Optimize SQL query performance
- Productionize AI models
- Set up security data platform
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | AWS Glue | AWS IAM | AWS KMS | AWS Lambda | AWS Secrets | AWS Secrets Manager | AWS Step Functions | Amazon Athena | Amazon CloudWatch | Amazon DynamoDB | Amazon EC2 | Amazon EMR | Amazon Kinesis | Amazon Redshift | Amazon S3 | Amazon SNS | Amazon SQS | CI/CD | DBT | Data encryption | DevSecOps | Docker | Event Driven | Event-driven architecture | Infrastructure as Code | Jenkins | Kafka | Kubernetes | PySpark | Python | SQL | SSL/TLS | Secrets Manager | Snowflake | Spark | Step Functions | Terraform | “as-code”
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
Related jobs
-
Senior-level Full TimeHyderabad, IND-TG, India5h ago
-
Planview Administration 169576 INR 1500K-2500KData Governance | Data Modeling | Data Pipelines | Data Validation | ELTSenior-level Full TimeHyderabad, IND-TG, India5h ago
-
Sr.DataOPS Developer INR 2000K-3000KAWS Greengrass | Airflow | Apache Flink | Apache Kafka | Apache Kafka StreamsSenior-level Full TimeBangalore, India8h ago
-
Data Scientist INR 3000K-5000KAWS | Airflow | Amazon SageMaker | Apache Spark | Azure Machine LearningSenior-level Full TimeIN-MH-Pune10h ago
-
Net Core Azure Cosmos DB Gen AI INR 1800K-3300K.NET | API Management | ASP.Net Core | App Service | Application InsightsMid-level Full TimeIN-KA-Bangalore10h ago
-
Senior-level Full TimeIN-AP-Hyderabad10h ago
-
Senior Applied AI/ML Engineer INR 3500K-5000KAgentic Systems | Autonomous Agents | Bias Mitigation | Data Analysis | Deep learningSenior-level Full TimeBengaluru, Karnataka, India11h ago
-
Forward Deployed Engineer, Google Cloud Business Platform INR 2500K-5000KArtificial Intelligence | Content Security | Content Security Policy | Data Storage | Distributed ComputingSenior-level Full TimeBengaluru, Karnataka, India11h ago
-
Assistant Manager- Python Gen AI with GCP- Bangalore INR 1500K-2500KADK | AI Agents | API Development | Agile | Cloud platformWork from client office 5 days per weekMid-level Full TimeBangalore, Karnataka, India11h ago
-
Senior-level Full TimeBangalore, Karnataka, India11h ago
-
Database Engineering Associate - Snowflake Developer INR 1500K-2000KAPI Integration | AWS | Access Management | Agile | Batch ProcessingFlexible hybrid work model | Health insurance | Life insurance | Paid time off | Pension/retirement benefitsMid-level Full TimeHyderabad, India R12h ago
-
ETL, Data Modeler, Advanced SQL/Senior Consultant Specialist INR 3000K-4000KA/B | A/B Testing | APIs | Airflow | AlationContinuous professional development | Flexible working | Inclusive and diverse environmentSenior-level Full TimeHyderabad, Telangana, India12h ago
-
Data Engineer (.NET Specialist) INR 2400K-3380K.Net Core | ASP.NET | Angular | App Service | Azure AppCustomer-facing role | On call support rewardsSenior-level Full TimePune, MH, India12h ago
-
Business Intelligence Engineer - Snowflake Developer INR 2500K-4132KAgile | Airflow | Bitbucket | CI/CD | Common table expressionsFlexible remote days | Health insurance | Hybrid work model | Life insurance | Paid time offSenior-level Full TimeHyderabad, India R13h ago
-
Mid-level Full TimeChennai, Tamil Nadu, India13h ago
-
Data Engineer (AWS+Pyspark) INR 1500K-2000KAWS Glue | Amazon Athena | Amazon Aurora | Amazon DynamoDB | Amazon EC2Mid-level Full TimeHyderabad, Telangana, India13h ago
-
Business Intelligence Engineer - Power BI Developer INR 1500K-2000KAgile | BI Performance Tuning | DAX | Data Modeling | Dimension modelingFlexible remote work | Health insurance | Hybrid work model | Life insurance | Paid time offMid-level Full TimeHyderabad, India R13h ago
-
Software Engineer(Python, Kubernetes, Microservices) INR 2000K-4000KAWS | Automated testing | Azure | Best practices | CI/CDSenior-level Full TimeBangalore, India Office (BANGALORE)14h ago
-
Mid-level Full TimeMumbai, Maharashtra, India14h ago
-
AM - Cloud Data Engineer INR 1500K-2500KAWS Lake Formation | Apache Airflow | Apache Kafka | Apache Spark | AzureSenior-level Full TimePune, Maharashtra, India15h ago
-
QE for AI Engineer INR 3000K-4000KAdversarial Testing | Benchmarking | CI/CD | Data Lineage | EvaluationSenior-level Full TimePune, Maharashtra, India15h ago
-
Staff Engineer INR 4000K-5500KAgentic Workflows | Artificial Intelligence | BigQuery | Cloud platform | CrewAISenior-level Full TimeChennai, Tamil Nadu, India15h ago
-
Data & Analytics Engineer - Consultant INR 1500K-3000KData Director | Data Governance | Data Management | Data Quality | ETLSenior-level Full TimeBangalore, Karnataka, India15h ago
-
Digital Finance CoE - Azure Data Engineer - Executive INR 1500K-6000KAWS Glue | Azure | Azure Data | Azure Data Factory | Azure DatabricksExecutive-level Full TimeBangalore, Karnataka, India15h ago
-
Compliance Engineering - Data Eng - Analyst - Bengaluru INR 1685K-2700KAI code generation | API | Automated testing | Code generation | DatabaseMid-level Full TimeBengaluru, Karnataka, India15h ago