Data Engineer - Guidewire
Tasks
- Analyze integration and system requirements
- Build dashboards and reports
- Build data models and schemas
- Conduct root cause analysis
- Create embeddings and vector search datasets
- Create unit scenario and end to end tests
- Design ELT pipelines
- Enrich data with metadata and context
- Implement data governance, security, and compliance
- Monitor generative AI data workflows
- Optimize data storage and retrieval for low latency responses
- Optimize pipeline and storage performance
- Prepare and clean large datasets for model training
- Process structured and unstructured data for generative AI
- Support model training and inference
- Troubleshoot data issues
Perks/Benefits
- N/A
Skills/Tech-stack
Access Control | Agile Development | Apache Spark | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Data Lake Storage Gen2 | Azure Databricks | Azure Event | Azure Event Grid | Azure Key Vault | Azure SQL | Azure SQL Database | CI/CD | Data Factory | Data Governance | Data Lake Storage Gen2 | Data Modeling | Data Quality | Data Security | Data Warehousing | Data integration | Delta Lake | ELT | ETL | Embeddings | Encryption | Event Grid | Key Vault | Metadata Management | MySQL | Oracle | Power BI | SQL | SQL Database | SQL Server | Vector Databases
Education
Associate Degree | Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
Related jobs
-
Staff Software Engineer - Core Ingest USD 191K-224KAgile Development | Apache Kafka | Distributed Systems | Docker | Fault ToleranceHealth insurance | Paid time off | Remote work optionsSenior-level Full TimeUnited States, Remote R7h ago
-
ArcGIS Pro | Arcpy | Bokeh | Dash | GDAL401k | Dental insurance | Health insurance | Vision insuranceSenior-level Full TimeFayetteville, North Carolina, United States10h ago
-
ArcGIS Pro | Arcpy | Bokeh | Dash | GDAL401k | Dental insurance | Health insurance | TS/SCI clearance | Vision insuranceSenior-level Full TimeSneads Ferry, North Carolina, United States10h ago
-
Data Engineer - Mid-Level USD 130K-160KAirflow | Automated Deployment | Automated testing | CI/CD | Control workflows401k matching | Dental insurance | Health insurance | Lunch and snacks provided | Maternity & paternity leaveMid-level Full TimeEl Segundo, California, United States10h ago
-
Software Engineer – Surgical Robot Manufacturing USD 127K-192KAutomated testing | Control Systems | HTML | JSON | JavaScriptMid-level Full TimeSunnyvale, CA, United States10h ago
-
Senior-level Full TimeRemote - United States R11h ago
-
Senior Software Engineer - Experiment Platform USD 159K-235KA/B | A/B Testing | B testing | Data Pipelines | Data Quality401k plan | Basic life insurance | Dental insurance | Flexible time off | Long-Term Disability coverageSenior-level Full TimeSeattle, Washington, United States11h ago
-
Sr. Applied AI Engineer USD 160K-200KAPIs | Cloud Computing | Generative AI | Machine Learning | PythonHome-office equipment | Hybrid work model | Self-development budget | Top of market equity and cash compensation packageSenior-level Full TimeNew York Office11h ago
-
Applied AI Engineer USD 110K-160KGenerative AI | Machine Learning | Python | REST APIs | SQLEquipment provided | Hybrid work | Mentorship | Self-development budgetMid-level Full TimeNew York Office11h ago
-
Sr. Staff Machine Learning Engineer, Content Quality USD 268K-469KApache Flink | Apache Hadoop | Apache Kafka | Apache Spark | Big DataSenior-level Full TimeSan Francisco, CA, US12h ago
-
Senior Full Stack Software Development Engineer - AI USD 135K-188KAWS | Agile | Amazon SQS | Automated testing | CI/CD401k matching | Flexible time off | Fully remote | Medical, dental, and vision coverage | Paid HolidaysSenior-level Full TimeUnited States, UNITED STATES, United States R12h ago
-
Senior Data Engineer (Health Research Team) USD 104K-199KAWS EC2 | AWS S3 | Apache Spark | Azure | Data Governance401k plan | Employee Assistance Program (EAP) | Family building benefits | Flexible Spending Accounts FSA | Flexible work arrangementsSenior-level Full TimeChicago, Illinois, United States R13h ago
-
AWS | Azure | CI/CD | Cloud platform | Data PipelinesLong-term contractSenior-level Contract Full TimeDallas, TX, United States13h ago
-
Staff Softare Engineer, Cortex AI Infrastructure USD 236K-339KData Pipelines | Distributed Systems | FoundationDB | Go | High ThroughputSenior-level Full TimeUS-CA-Menlo Park13h ago
-
Sr. Data Platform Engineer - Computer System Validator USD 142K-220K21 CFR | 21 CFR Part 11 | Audit Trail | CFR Part 11 | Cloud platformBonus and equity compensation | Comprehensive benefits package | Hybrid work scheduleSenior-level Full TimeNew York, New York; Salt Lake …14h ago
-
Sr. Data Engineer USD 120K-160KAPI | AWS | AWS Glue | Airflow | Amazon RedshiftComprehensive benefits package | In-person collaboration opportunities | Mentorship and growth opportunities | On-call rotation | Remote-firstSenior-level Full TimeOrlando, FL, United States R14h ago
-
Senior AI ML Engineer USD 137K-188KAPI Integration | AWS | AWS Bedrock | AWS Fargate | AWS GlueCareer growth opportunities | Flexible work schedule | Remote-first work environmentSenior-level Contract Full TimeUnited States14h ago
-
Staff AI Research Engineer USD 220K-331KArtificial Intelligence | Computer Vision | Feature Engineering | Fine Tuning | Language ModelsCollaboration | Learning opportunities | Mentorship | Professional developmentSenior-level Full TimePittsburgh, PA15h ago
-
Junior Software Engineer (Backend + AI) USD 90K-110KAWS ECR | AWS S3 | Anthropic API | CI/CD | DjangoCodebase access to production projects | Hybrid work | Internship to production code | Training with AI engineering practicesEntry-level Full TimeGreater Boston Area15h ago
-
Perception Engineer USD 125K-220KC++ | CI/CD | CUDA | Computer Vision | Convolutional Neural NetworkHealth insurance | Professional development | Retirement plansSenior-level Full TimeHuntington Beach15h ago
-
Compute Optimization Researcher/Engineer USD 293K-455KApache Spark | CPLEX | Capacity Planning | Cloud Capacity | Cloud Capacity PlanningHybrid work model | Relocation assistanceMid-level Full TimeSan Francisco15h ago
-
Data Engineer, San Francisco, CA USD 140K-160KAPI | Airflow | Data Modeling | Data Warehouse | ETL401k | Accident Plan Insurance | Commuter benefits | Critical illness insurance | Dental insuranceMid-level Full TimeSan Francisco, CA15h ago
-
Data Engineer, Palo Alto USD 110K-180KAPI Integration | AWS | Data Governance | Data Modeling | Data Pipelines401k matching | Dental insurance | Flexible spending accounts | Health insurance | Mental health programMid-level Full TimePalo Alto, California, United States16h ago
-
Senior Machine Learning (ML) Engineer USD 165K-218KAir-gapped | Air-gapped systems | Airflow | Anomaly Detection | Apache Spark401k match | Caregiver leave | Commuter benefits | Dental benefits | Generous time offSenior-level Full TimeFort Collins, Colorado, United States16h ago
-
Senior Data Engineer USD 119K-182KAWS | AWS Glue | Apache Airflow | Apache Spark | AzureFlexible work schedules | Generous compensation package | Training and career developmentSenior-level Full TimeWashington D.C.16h ago