Data Platform Engineer (Member of Technical Staff)
Tasks
- Architect data lake indexing storage and query strategies
- Build ETL workflows
- Build enterprise data connectors
- Design data pipelines and indexing strategies
- Enable retrieval-augmented generation
- Extract insights from enterprise data
- Implement batch processing
- Implement semantic search
- Implement streaming systems
- Ingest and normalize enterprise data sources
- Integrate data platform components
- Make build vs buy decisions for data platform tools
- Manage orchestration and deployment workflows
- Run data pipelines
- Taxonomize correlate and deduplicate data
Perks/Benefits
- N/A
Skills/Tech-stack
Airflow | Apache Flink | Apache Kafka | Data Reliability | Data pipeline | Database Design | Databricks | Distributed Computing | Docker | ETL | Indexing | Information Retrieval | Knowledge graph | Kubernetes | Retrieval-Augmented Generation | SQL | Search | Semantic Search | Streaming Data | Temporal | Terraform
Education
N/A
Regions
Countries
States
Related jobs
-
Data Engineer USD 115K-175KAzure Data | Azure Data Factory | Azure Synapse | Azure Synapse Analytics | Copilot401k match | Company-sponsored life insurance | Dental insurance | Dress for your day | Flexible spending accountMid-level Full TimeColumbus, OH, United States4h ago
-
CRM | Cloud Computing | Data Migration | Data Pipelines | Data Quality401k match | Flexible spending accounts | Flexible work schedule | Life insurance | Long-term disabilityMid-level Full TimeBuffalo, NY, United States7h ago
-
Data Engineer ID50062 USD 147K-166KAWS | Advanced SQL | Advanced SQL optimization | Airflow | AvroFlextime | Mentorship | Remote work options | TechtalksSenior-level Full TimeTampa, United States8h ago
-
Data Engineer ID50062 USD 147K-166KAWS | AWS SageMaker | Advanced SQL | Advanced SQL optimization | Apache AirflowFlextime | Mentorship | Office options | Personalized growth roadmaps | Remote workSenior-level Full TimeTallahassee, United States8h ago
-
Data Engineer ID50062 USD 147K-166KAWS | AWS SageMaker | Apache Airflow | Apache Spark | AvroEducation budget | Fitness budget | Flexible schedule | Mentorship | Office workSenior-level Full TimeFort Lauderdale, United States8h ago
-
Data Engineer ID50062 USD 147K-166KAWS | AWS SageMaker | Airflow | Apache Spark | AvroFlextime | Mentorship | Office work options | Personalized growth roadmaps | Remote work optionsSenior-level Full TimeJacksonville, United States8h ago
-
Data Engineer ID50062 USD 147K-166KAWS | AWS SageMaker | Amazon S3 | Apache Airflow | Apache SparkEducation budget | Fitness budget | Flexible schedule | Mentorship | Personalized growth roadmapsSenior-level Full TimeHouston, United States8h ago
-
Data Engineer ID50062 USD 147K-166KAWS | AWS SageMaker | Apache Airflow | Apache Spark | AvroEducation budget | Fitness budget | Flexible schedule | Mentorship | Office optionsSenior-level Full TimeBlacksburg, United States8h ago
-
Data Engineer ID50062 USD 147K-166KAWS | Airflow | Apache Spark | Avro | DuckDBEducation budget | Fitness budget | Flexible schedule | Mentorship | Office work optionsSenior-level Full TimeWest Palm Beach, United States8h ago
-
Data Engineer ID50062 USD 147K-166KAPI Integration | Airflow | Amazon Web Services | Apache Spark | AvroEducation budget | Fitness budget | Flexible schedule | Mentorship | Personalized growth roadmapsSenior-level Full TimeBaltimore, United States8h ago
-
Data Engineer ID50062 USD 147K-166KAWS | Airflow | Apache Spark | Avro | DuckDBEducation budget | Fitness budget | Flexible schedule | Mentorship | Personalized growth roadmapsSenior-level Full TimeBoca Raton, United States8h ago
-
Data Engineer ID50062 USD 147K-166KAWS | Airflow | Apache Spark | Avro | Data LakehouseFlextime | Mentorship | Office work options | Personalized growth roadmaps | Remote work optionsSenior-level Full TimeAustin, United States8h ago
-
Data Engineer ID50062 USD 147K-166KAWS | Airflow | Apache Spark | Avro | Columnar StorageFlextime | Mentorship | Office options | Personalized growth roadmaps | Remote work optionsSenior-level Full TimeMiami, United States8h ago
-
Data Engineer ID50062 USD 147K-166KAWS | Airflow | Apache Spark | Avro | DuckDBEducation budget | Fitness budget | Flexible schedule | Mentorship | Personalized growth roadmapsSenior-level Full TimeRichmond, United States8h ago
-
Data Engineer ID50062 USD 147K-166KAWS | Airflow | Apache Spark | Avro | DuckDBFlexible schedule | Mentorship | Personalized growth roadmaps | Remote work options | TechtalksSenior-level Full TimeOrlando, United States8h ago
-
A/B | A/B Testing | B testing | ChatGPT | ClaudeMid-level ContractHarrisburg, United States9h ago
-
Agile | Automation | Data Quality | Data pipeline | Distributed Systems401k match | Dental insurance | Health insurance | Life insurance | Paid HolidaysSenior-level Full TimeNew York9h ago
-
Revenue Operations Analytics Engineer Momence USD 125K-145KAWS | DBT | Data Modeling | Data Quality | Data ValidationExtra days off for volunteering | Flexible working arrangements | Free mental health support | Paid parental leaveEntry-level Full TimeDenver, CO, United States10h ago
-
AI tool integration | Automated testing | Bias Mitigation | CSS | Ethical AISenior-level Full TimeMenlo Park, CA10h ago
-
Software Engineer AI/ML Networking USD 147K-211KC++ | Data Processing | Data Structures | Data Structures and Algorithms | DebuggingMid-level Full TimeRaleigh, NC, USA; Durham, NC, USA11h ago
-
Software Engineer, Google Cloud Storage USD 147K-211KAccess Control | Block Storage | C++ | Chaos Engineering | Cloud FunctionsMid-level Full TimeRaleigh, NC, USA; Durham, NC, USA11h ago
-
Staff Software Engineer, DevIntel Data Warehouse USD 207K-300KC++ | Dashboards | Data Analysis | Data Structures | Data Structures and AlgorithmsSenior-level Full TimeSeattle, WA, USA; Kirkland, WA, USA11h ago
-
Senior Software Engineer, Google Cloud Storage USD 174K-252KAccess Control | As-a-Service | Block Storage | C++ | Chaos TestingSenior-level Full TimeRaleigh, NC, USA; Durham, NC, USA11h ago
-
Attention Mechanisms | BERT | Data Processing | Debugging | Domain AdaptationSenior-level Full TimeMountain View, CA, USA11h ago
-
Algorithms | C++ | Cloud platform | Computer Vision | Data ProcessingSenior-level Full TimeSunnyvale, CA, USA11h ago