Senior Data Engineer
Tasks
- Build analytics ready datasets for pricing and underwriting
- Coordinate Fabric configuration access controls and security readiness
- Create documentation standards for models transformations and quality rules
- Define Lakehouse bronze silver gold strategy
- Design Microsoft Fabric ingestion patterns
- Implement data ingestion pipelines and incremental loads
- Implement data profiling reconciliation and validation outputs
- Lead end to end data architecture for sandbox
- Partner with actuarial teams to define required features
- Provide technical direction and code review
- Validate files and manage schemas
Perks/Benefits
- N/A
Skills/Tech-stack
Access Control | Azure | Data Governance | Data Ingestion | Data Modeling | Data Pipelines | Data Quality | Data Reconciliation | Data profiling | Incremental processing | Lakehouse | Microsoft Fabric | Notebooks | OneLake | Partitioning | Performance optimization | Python | SQL | Schema management | Security Configuration | Spark
Education
N/A
Roles
Related jobs
-
Mid-level Full TimeBangalore, KA, IN, 5600764h ago
-
Engineering Technical Leader – Embedded Software INR 3000K-3500KBash | Board Support | Board Support Package | Bootloader | C plus plusSenior-level Full TimeBengaluru, India4h ago
-
AWS | Airbyte | Airflow | Azure | CI/CDCollaboration across teams | Inclusive work environment | Learning opportunities | Professional growth | Remote workSenior-level Full TimeIndia4h ago
-
Senior Analytics Engineer – Data Applications INR 2771K-4064KAirflow | Anomaly Detection | Apache Spark | CI/CD | DBTSenior-level Full TimeBengaluru, INDIA, India5h ago
-
.NET | APIs | Automation | C Sharp | CrewAIAccess to AI tools | Accidental insurance | Casual leave | Earned Leave | Flexible autonomySenior-level Full TimeIndia5h ago
-
Senior Data Engineer INR 3000K-4000KA/B | A/B Testing | AWS | Apache Airflow | Apache HiveAccident insurance | Disability insurance | Financial wellness support | Flexible work schedule | Healthcare benefitsSenior-level Full TimeBengaluru, India6h ago
-
IN-Senior Associate_ Data Engineer Databricks_Data and Analytics_Advisory_ Bangalore INR 1500K-2500KAWS | Agile | Amazon Web Services | Apache Spark | Auto LoaderSenior-level Full TimeBengaluru Millenia, India10h ago
-
AWS Glue | AWS S3 | Amazon Bedrock | Amazon Kinesis | Amazon RedshiftFlexibility | Global collaboration | Growth and development | Healthy work-life balance | Remote-first work modelSenior-level Full TimeIndia16h ago
-
Engineering Lead,Microservices,Java Springboot /Sr. Associate Director, Technology Management INR 1500K-2400KApache Airflow | Apache Beam | Apache Flink | BigQuery | Cloud StorageMid-level Full TimePune, Maharashtra, India R18h ago
-
Senior-level Full TimeIndia, Bengaluru (Hybrid) R18h ago
-
Data Engineer II INR 2800K-3584KApache Airflow | BigQuery | CI/CD | Cloud Run | Cloud Run FunctionsSenior-level Full TimeIndia, Chennai18h ago
-
Applied AI Engineer INR 3264K-5876KAWS | Agent systems | Authentication | Autonomous Agents | AzureHybrid work | Mental health counseling | Paid volunteer time off | Subsidized Wellhub membership | Unlimited PTOSenior-level Full TimeBangalore, India19h ago
-
Sr. Cloud Engineer - Databricks/AI focus ( 5-9 years) Bangalore INR 2400K-3000KAKS | Bash | BigQuery | CI/CD | Cloud SecuritySenior-level Full TimeBengaluru, KA, India19h ago
-
Vice President - AI/ML Technical Developer INR 4000K-5199KAgentic Frameworks | Alerting | Automated testing | Cause analysis | Code reviewExecutive-level Full TimeBengaluru, Karnataka, India21h ago
-
ARM Microcontroller | Arc | C# | Clock | DMAEntry-level Full TimeBengaluru, KA, India21h ago
-
Senior Digital Solutions Consultant INR 3000K-4000KAPIs | Amazon Web Services | Azure SQL | Conceptual data model | Data GovernanceSenior-level Full TimeIND-TN-Chennai21h ago
-
Data Engineer (Python ETL) INR 800K-2000KETL | Oracle Database | PL/SQL | Performance Tuning | PythonMid-level Full TimeIN-MH-Pune21h ago
-
Mid-level Full TimeIN-MH-Pune21h ago
-
API Design | AWS | Apache Spark | Azure | Big DataSenior-level Full TimeBangalore - Karnataka - India Pune …21h ago
-
Senior Analytics Engineer INR 3000K-4000KAWS | Cloud platform | Confluent Cloud | DBT | Data IngestionAgile team collaboration | Knowledge sharing culture | Mentorship opportunitiesSenior-level Full TimeBangalore - Karnataka - India Pune …21h ago
-
DS / ML Engineer INR 1800K-3000KData Pipelines | Drift Detection | Inference Optimization | Information Retrieval | LLMMid-level Full TimeBangalore22h ago
-
Snowflake Data Engineer- Consultant INR 1500K-2000KAWS Glue | AWS Lambda | AWS S3 | Access policies | AirflowCorporate social responsibility programs | Discounts on products and services | Maternity leave | Networking opportunities | Paternity leaveMid-level Full TimeBangalore, Karnataka, India22h ago
-
Data Architect INR 1500K-2500KAWS Glue | AWS Lambda | Amazon Kinesis | Amazon Redshift | Amazon S3Professional developmentSenior-level Full TimeBengaluru, Pune22h ago
-
Principal Engineer, Technical Architect INR 2000K-5000K.NET | API first | API-first design | Access Control | Agent OrchestrationSenior-level Full TimeRemote, India R22h ago
-
Principal Engineer, Technical Architect INR 2000K-5000K.NET | API Design | Access Control | Artificial Intelligence | Batch inferenceSenior-level Full TimeRemote, India R22h ago