Data Engineer - Guidewire
Tasks
- Analyze integration and system requirements
- Build dashboards and reports
- Build data models and schemas
- Conduct root cause analysis
- Create embeddings and vector search datasets
- Create unit scenario and end to end tests
- Design ELT pipelines
- Enrich data with metadata and context
- Implement data governance, security, and compliance
- Monitor generative AI data workflows
- Optimize data storage and retrieval for low latency responses
- Optimize pipeline and storage performance
- Prepare and clean large datasets for model training
- Process structured and unstructured data for generative AI
- Support model training and inference
- Troubleshoot data issues
Perks/Benefits
- N/A
Skills/Tech-stack
Access Control | Agile Development | Apache Spark | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Data Lake Storage Gen2 | Azure Databricks | Azure Event | Azure Event Grid | Azure Key Vault | Azure SQL | Azure SQL Database | CI/CD | Data Factory | Data Governance | Data Lake Storage Gen2 | Data Modeling | Data Quality | Data Security | Data Warehousing | Data integration | Delta Lake | ELT | ETL | Embeddings | Encryption | Event Grid | Key Vault | Metadata Management | MySQL | Oracle | Power BI | SQL | SQL Database | SQL Server | Vector Databases
Education
Associate Degree | Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
Related jobs
-
Staff Software Engineer - Core Ingest USD 191K-224KAgile Development | Apache Kafka | Distributed Systems | Docker | Fault ToleranceHealth insurance | Paid time off | Remote work optionsSenior-level Full TimeUnited States, Remote R6h ago
-
ArcGIS Pro | Arcpy | Bokeh | Dash | GDAL401k | Dental insurance | Health insurance | Vision insuranceSenior-level Full TimeFayetteville, North Carolina, United States8h ago
-
ArcGIS Pro | Arcpy | Bokeh | Dash | GDAL401k | Dental insurance | Health insurance | TS/SCI clearance | Vision insuranceSenior-level Full TimeSneads Ferry, North Carolina, United States8h ago
-
Data Engineer - Mid-Level USD 130K-160KAirflow | Automated Deployment | Automated testing | CI/CD | Control workflows401k matching | Dental insurance | Health insurance | Lunch and snacks provided | Maternity & paternity leaveMid-level Full TimeEl Segundo, California, United States9h ago
-
Senior-level Full TimeRemote - United States R10h ago
-
Senior Software Engineer - Experiment Platform USD 159K-235KA/B | A/B Testing | B testing | Data Pipelines | Data Quality401k plan | Basic life insurance | Dental insurance | Flexible time off | Long-Term Disability coverageSenior-level Full TimeSeattle, Washington, United States10h ago
-
Sr. Applied AI Engineer USD 160K-200KAPIs | Cloud Computing | Generative AI | Machine Learning | PythonHome-office equipment | Hybrid work model | Self-development budget | Top of market equity and cash compensation packageSenior-level Full TimeNew York Office10h ago
-
Applied AI Engineer USD 110K-160KGenerative AI | Machine Learning | Python | REST APIs | SQLEquipment provided | Hybrid work | Mentorship | Self-development budgetMid-level Full TimeNew York Office10h ago
-
Sr. Staff Machine Learning Engineer, Content Quality USD 268K-469KApache Flink | Apache Hadoop | Apache Kafka | Apache Spark | Big DataSenior-level Full TimeSan Francisco, CA, US10h ago
-
Senior Full Stack Software Development Engineer - AI USD 135K-188KAWS | Agile | Amazon SQS | Automated testing | CI/CD401k matching | Flexible time off | Fully remote | Medical, dental, and vision coverage | Paid HolidaysSenior-level Full TimeUnited States, UNITED STATES, United States R11h ago
-
AWS | Azure | CI/CD | Cloud platform | Data PipelinesLong-term contractSenior-level Contract Full TimeDallas, TX, United States12h ago
-
Sr. Data Platform Engineer - Computer System Validator USD 142K-220K21 CFR | 21 CFR Part 11 | Audit Trail | CFR Part 11 | Cloud platformBonus and equity compensation | Comprehensive benefits package | Hybrid work scheduleSenior-level Full TimeNew York, New York; Salt Lake …12h ago
-
Sr. Data Engineer USD 120K-160KAPI | AWS | AWS Glue | Airflow | Amazon RedshiftComprehensive benefits package | In-person collaboration opportunities | Mentorship and growth opportunities | On-call rotation | Remote-firstSenior-level Full TimeOrlando, FL, United States R13h ago
-
Senior AI ML Engineer USD 137K-188KAPI Integration | AWS | AWS Bedrock | AWS Fargate | AWS GlueCareer growth opportunities | Flexible work schedule | Remote-first work environmentSenior-level Contract Full TimeUnited States13h ago
-
Staff AI Research Engineer USD 220K-331KArtificial Intelligence | Computer Vision | Feature Engineering | Fine Tuning | Language ModelsCollaboration | Learning opportunities | Mentorship | Professional developmentSenior-level Full TimePittsburgh, PA13h ago
-
Junior Software Engineer (Backend + AI) USD 90K-110KAWS ECR | AWS S3 | Anthropic API | CI/CD | DjangoCodebase access to production projects | Hybrid work | Internship to production code | Training with AI engineering practicesEntry-level Full TimeGreater Boston Area14h ago
-
Perception Engineer USD 125K-220KC++ | CI/CD | CUDA | Computer Vision | Convolutional Neural NetworkHealth insurance | Professional development | Retirement plansSenior-level Full TimeHuntington Beach14h ago
-
Data Engineer, San Francisco, CA USD 140K-160KAPI | Airflow | Data Modeling | Data Warehouse | ETL401k | Accident Plan Insurance | Commuter benefits | Critical illness insurance | Dental insuranceMid-level Full TimeSan Francisco, CA14h ago
-
Data Engineer, Palo Alto USD 110K-180KAPI Integration | AWS | Data Governance | Data Modeling | Data Pipelines401k matching | Dental insurance | Flexible spending accounts | Health insurance | Mental health programMid-level Full TimePalo Alto, California, United States14h ago
-
Senior Machine Learning (ML) Engineer USD 165K-218KAir-gapped | Air-gapped systems | Airflow | Anomaly Detection | Apache Spark401k match | Caregiver leave | Commuter benefits | Dental benefits | Generous time offSenior-level Full TimeFort Collins, Colorado, United States14h ago
-
Senior Data Engineer USD 119K-182KAWS | AWS Glue | Apache Airflow | Apache Spark | AzureFlexible work schedules | Generous compensation package | Training and career developmentSenior-level Full TimeWashington D.C.15h ago
-
Software Engineer, Infrastructure - Autonomy & Robotics USD 130K-285KAlgorithms | Data Processing | Data Structures | Distributed Systems | Distributed data401k match | Basic life insurance | Commuter benefits match | Dental benefits | Disability insuranceMid-level Full TimeSan Francisco, CA15h ago
-
Senior Consumer Analytics Engineer I USD 130K-180KAirflow | CI/CD | DBT | Dagster | Data Governance401k program | Employee resource groups | Fitness and wellness memberships | Flexible work environment | Learning and development stipendSenior-level Full TimeAustin15h ago
-
Senior Machine Learning Platform Engineer USD 160K-210KAutomated retraining | C plus plus | CI/CD | Docker | Elasticsearch401k match | Annual bonus | Company equipment provided | Company in person events | Company medical dental vision plansSenior-level Full TimeAtlanta, GA preferred, Remote R15h ago
-
Data Engineer USD 133K-159KBigQuery | Cloud platform | DBT | Data Governance | Data Modeling401k matching | Employee assistance program | Employee stock purchase program | Flexible vacation | Hybrid work modelMid-level Full TimeSan Francisco, CA R16h ago