Principal Software Engineer, Real Time Data Enrichment Platform (Hybrid)
Tasks
- Build query analysis for structured data
- Build unified data catalog
- Design develop and maintain petabyte scale data platform
- Improve service efficiency
- Optimize query performance with indexing and partitioning
- Own design build and delivery of data enrichment platform
- Participate in technical reviews and enhance stability
- Research and implement ways to query data efficiently and extract results
- Shape analytics data platform vision
Perks/Benefits
- Competitive vacation and holidays
- Comprehensive wellness programs
- Employee networks
- Great Place to Work certified
- Paid parental and adoption leaves
- Professional development opportunities
- Remote work flexibility
- Volunteer opportunities
Skills/Tech-stack
Apache Cassandra | Apache Druid | Apache Flink | Apache Hadoop | Apache Hive | Apache Iceberg | Apache Kafka | Apache Pinot | Apache Presto | Apache Spark | Data Partitioning | Delta Lake | Distributed Systems | Garbage Collection | Indexing | Kubernetes | Linux | Memory Management | NoSQL | OLAP | Relational databases | SQL | Test-Driven | Test-Driven Development | Time Series | Trino
Education
Regions
Countries
States
Cities
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R18d ago
-
Data Engineer - AI, Hybrid USD 137K-200KDBT | Data Cleansing | Data Imputation | Data Modeling | Data Quality401k matching contribution | 401k plan | Disability coverage | Hybrid work model | Life insuranceSenior-level Full TimeUSA-RESEARCH TRIANGLE PARK, United States R23h ago
-
Staff Data Eng, Data Systems, TCGplayer USD 136K-228KAccess Control | Change Data Capture | Cost Management | Data Capture | Data Governance401k eligibility | Medical benefits | Paid time off | Parental leave | Remote work not available for U S visa sponsorshipSenior-level Full TimeRemote Oregon, United States R23h ago
-
Analytics Data Engineer USD 100K-120KAWS | Artificial Intelligence | Automation Scripting | Azure | CI/CD401k matching | All-hands meetings | Cell phone reimbursement | Dental insurance | FSA accountSenior-level Full TimeUnited States - Remote R23h ago
-
Big Data Application Developer USD 100K-150KAWS EMR | Airflow | Apache Atlas | Apache Flink | Apache HBaseRemote workSenior-level Full TimeUnited States - Remote R23h ago
-
Hadoop Big Data Developer USD 100K-150KAirflow | Apache Atlas | Apache Flink | Apache Hive | Apache HudiRemote workSenior-level Full TimeUnited States - Remote R23h ago
-
Data Engineer USD 72K-130KApache Spark | Azure | Azure Data | Azure Data Factory | Azure Data Lake401k contribution | Career development opportunities | Comprehensive benefits package | Equity stock purchase | Incentive and recognition programsSenior-level Full TimeEden Prairie, Minnesota, UNITED STATES; REMOTE R23h ago
-
AI Data Engineer USD 100K-150KApache Beam | CI/CD | Caching | Code review | CompressionRemote workSenior-level Full TimeUnited States - Remote R23h ago
-
ML Data Engineer USD 100K-150KApache Beam | CI/CD | Code review | Data Lineage | Data ModelingCareer growth | Remote workMid-level Full TimeUnited States - Remote R23h ago
-
Data Platform Engineer USD 100K-150KAutoscaling | C++ | CUDA | Capacity Planning | Distributed SystemsCareer growth | Remote workSenior-level Full TimeUnited States - Remote R23h ago
-
Azure Data and MLOps Engineer USD 116K-222KActive Directory | Azure Active Directory | Azure Data | Azure Data Factory | Azure Data Lake401k match | Company paid life insurance | Company paid vision plan | Company-paid disability insurance | PTOSenior-level ContractUnited States - Remote R23h ago
-
AI Operations Engineer USD 150K-165KApache Beam | CI/CD | Code review | Data Lineage | Data ModelingCareer growth | Full-time employment | Remote workSenior-level Full TimeUnited States - Remote R23h ago
-
Senior-level Full TimeWestford, MA R23h ago
-
ML Systems Engineer USD 145K-165KAPI Integration | Autoscaling | C++ | Capacity Planning | Distributed SystemsSenior-level Full TimeUnited States - Remote R23h ago
-
Model Optimization Engineer USD 150K-175KC++ | Compiler optimization | Cutlass | Deep learning | DeepSpeedSenior-level Full TimeUnited States - Remote R23h ago
-
Foundation Model Engineer USD 200K-230KAWS | Azure | CI/CD | Cloud platform | DeepSpeedRemote work opportunitySenior-level Full TimeUnited States - Remote R23h ago
-
Senior-level Full TimeUnited States - Remote R23h ago
-
Storage Systems Engineer USD 100K-150KAnsible | CSI | Capacity Planning | Ceph | Cost OptimizationCareer growth | Remote workSenior-level Full TimeUnited States - Remote R23h ago
-
Senior Staff AI Engineer USD 135K-178KAPI Development | AWS | Airflow | Anthropic | AutogenDiversity and inclusion | Employee mentoring | Inclusive culture | Remote work optionsSenior-level Full TimeOakland, CA; Remote (United States) R1d ago
-
AI Center | AI orchestration | Action Center | Agile | AuthenticationMid-level ContractNashville, United States R2d ago
-
Big Data Engineer USD 100K-150KAWS EMR | Airflow | Apache Atlas | Apache Hudi | Apache IcebergRemote workSenior-level Full TimeUnited States - Remote R2d ago
-
Streaming Data Engineer USD 100K-150KACLs | AWS MSK | Ansible | Apache Flink | Apache KafkaRemote workSenior-level Full TimeUnited States - Remote R2d ago
-
Machine Learning Data Engineer USD 100K-150KApache Beam | Apache Spark | CI/CD | Code review | Data LineageRemote workSenior-level Full TimeUnited States - Remote R2d ago
-
Machine Learning Infrastructure Engineer USD 100K-150KAutoscaling | Batching | C++ | Caching | Capacity PlanningSenior-level Full TimeUnited States - Remote R2d ago
-
Senior-level Full TimeUnited States - Remote R2d ago