Data Engineer
Tasks
- Build Snowflake tables views stages and secure data shares
- Collaborate with analytics and ML teams for self service
- Develop ELT/ETL pipelines
- Implement SQL and Python transformations
- Implement security scanning secrets management and least privilege IAM
- Ingest data into Snowflake
- Monitor logging metrics lineage and data quality checks
- Orchestrate data workflows and schedule jobs
- Set up CI CD for data code testing and automation
- Tune queries manage RBAC and warehouse configurations
- Write documentation runbooks and data dictionaries
Perks/Benefits
Skills/Tech-stack
AWS | Airflow | Azure | Azure Bicep | Azure Data | Azure Data Factory | Azure DevOps | CI/CD | Change Data Capture | Cloud Composer | CloudFormation | CloudWatch | Conftest | DBT | Data Capture | Data Factory | Data Validation | Datadog | ELT | ETL | GCP | Git | GitHub Actions | GitLab CI | Great Expectations | IAM | Kafka | Kafka Connect | Kinesis | Log Analytics | OPA | OpenLineage | Pandas | Policy-as-Code | Prefect | PubSub | Pytest | Python | RBAC | S3 | SQL | SQLAlchemy | Snowflake | Terraform | Unit Testing | “as-code”
Education
N/A
Roles
Related jobs
-
Gen Ai INR 2000K-3000KAI Agents | AI Governance | AWS CodePipeline | Agent architecture | AuthenticationMid-level Full TimeIN-KA-Bangalore1h ago
-
Mid-level Full TimeIN-TN-Chennai1h ago
-
Agentic AI Engineer INR 1800K-2500KAI orchestration | API Integration | Automated testing | Automation | Azure DevOpsMid-level Full TimeIndia, West Bengal, Kolkata2h ago
-
Senior-level Full TimeGurugram, India3h ago
-
Senior QA Engineer(Data Platform Testing) INR 2515K-2829KAPI Gateway | API Testing | AWS Lambda | Alerting | CI/CDReward and recognition | Volunteering opportunities | Wellness | Work-life balanceSenior-level Full TimeHyderabad, India4h ago
-
Applied AI ML Associate INR 3799K-5000KAWS | Artificial Intelligence | Cloud platform | Data Analysis | Data PipelinesEntry-level Full TimeBengaluru, Karnataka, India5h ago
-
Lead Software Engineer INR 4000K-5000KAWS | Agent Development | Agent systems | Amazon ECS | Amazon EKSSenior-level Full TimeBengaluru, Karnataka, India5h ago
-
Applied AI ML Lead INR 3264K-5000KAI Libraries | API Development | AWS | Agentic AI | Agentic AI librariesSenior-level Full TimeBengaluru, Karnataka, India9h ago
-
APIs | CI/CD | Cloud Computing | Distributed Systems | JavaCoworking stipend | Flexible savings accounts | Health coverage | Remote work | Sick leaveSenior-level Full TimeBengaluru, Karnataka, India10h ago
-
Senior Data Systems Software Engineer INR 1500K-3000KA/B | A/B Testing | API Versioning | API interoperability | AutomationLife insurance | Medical insurance | Retirement options | Volunteer programsSenior-level Full TimeBENGALURU, KARNATAKA, India11h ago
-
Mid-level Full TimePune, MH, IN, 41101412h ago
-
Senior AI Engineer - LLM Evaluation INR 3740K-5876KAI Governance | AI Observability | AWS | Azure | BenchmarkingSenior-level Full TimeAPAC - India - Bengaluru - …14h ago
-
Lead Data Engineer/ Data Architect INR 2000K-2800KAgile | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageSenior-level Full TimeHyderabad, Telangana, India - Remote R14h ago
-
Mid-level Full TimeBangalore, KA, IN14h ago
-
Data Engineer INR 1500K-2500KData Analysis | Data Engineering | Data Management | Data Modeling | Data pipelineHybrid workingSenior-level Full TimeHyderabad Knowledge Park Tower 2, India14h ago
-
IN_Senior Manager_ AWS Bedrock Engineer_D&A_Advisory_Mumbai INR 1960K-4000KAPI Gateway | APIs | AWS Bedrock | AWS CloudFormation | AWS LambdaSenior-level Full TimeMumbai Shivaji Park, India14h ago
-
Agile | Angular | Bash | CI/CD | Continuous integrationSenior-level Full TimeMumbai Goregaon, India14h ago
-
IN_Senior Associate_GenAI and Agentic AI_GCC_Advisory_Bangalore INR 2500K-5000KAPI Development | Asynchronous programming | Autogen | CI/CD | CrewAISenior-level Full TimeBengaluru Millenia, India14h ago
-
IN_Senior Associate_GenAI and Agentic AI_GCC_Advisory_Bangalore INR 2500K-5000KAPI Development | Async Programming | Autogen | CI/CD | CrewAIFlexibility programs | Inclusive benefits | Mentorship | Wellbeing supportSenior-level Full TimeBengaluru Millenia, India14h ago
-
Entry-level Full TimeBangalore, IN14h ago
-
Sr Software Developer INR 2040K-2500KAWS | Angular | Apache Airflow | Apache Beam | AzureGuided career tracks | Health care benefits | Hybrid work model | Online learning platform | Paid time offSenior-level Full TimeIND-Trivandrum-Equifax Analytics-PEC, India14h ago
-
Custom Software Engineer INR 1300K-2000KAWS | Apache Airflow | Data Warehousing | Data integration | Data pipelineMid-level Full TimeBengaluru, BDC7A, India14h ago
-
Mid-level Full TimeBengaluru, BDC6F, India14h ago
-
Mid-level Full TimeBengaluru, BDC6F, India14h ago
-
Custom Software Engineer INR 1000K-1500KCloud Storage | Code review | Data Engineering | Data Governance | Data SecurityMid-level Full TimeBengaluru, BDC14A, India14h ago