Data Platform Engineer (Member of Technical Staff)
Tasks
- Architect data lake indexing storage and query strategies
- Build ETL workflows
- Build enterprise data connectors
- Design data pipelines and indexing strategies
- Enable retrieval-augmented generation
- Extract insights from enterprise data
- Implement batch processing
- Implement semantic search
- Implement streaming systems
- Ingest and normalize enterprise data sources
- Integrate data platform components
- Make build vs buy decisions for data platform tools
- Manage orchestration and deployment workflows
- Run data pipelines
- Taxonomize correlate and deduplicate data
Perks/Benefits
- N/A
Skills/Tech-stack
Airflow | Apache Flink | Apache Kafka | Data Reliability | Data pipeline | Database Design | Databricks | Distributed Computing | Docker | ETL | Indexing | Information Retrieval | Knowledge graph | Kubernetes | Retrieval-Augmented Generation | SQL | Search | Semantic Search | Streaming Data | Temporal | Terraform
Education
N/A
Regions
Countries
States
Related jobs
-
Senior Data Engineer (Remote) USD 155KAgile | Apache Spark | BigQuery | Cassandra | Data Governance401k match | Dental insurance | Employee assistance program | Employee stock purchase plan | Flexible scheduleSenior-level Full TimeWork From Home, United States R5h ago
-
Senior AI Operations Engineer USD 170K-180KAI infrastructure | Azure | CI/CD | Cloud infrastructure | Container Engine for Kubernetes401k match | Employee assistance program | Employee stock purchase plan | Flexible schedule | Flexible spending accountSenior-level Full TimeWork From Home, United States R5h ago
-
API Development | Airflow | Automated retraining | CI/CD | Cloud PlatformsEquityMid-level Full TimeNaples, United States8h ago
-
API Design | AWS | AWS Cloud | AWS Cloud Development Kit | AWS cloud developmentSenior-level ContractGlendale, United States9h ago
-
Mid-level Full TimeUS-Kansas-Wichita9h ago
-
Senior-level Full TimeCincinnati, OH, United States9h ago
-
Acceptance Testing | Data Analysis | Data Visualization | Data reporting | ExcelOn site work authorizationSenior-level Full TimeArlington/Rosslyn, Virginia, United States10h ago
-
Delivery Senior Consultant, Data Engineering and Gen AI USD 119K-208K.NET | AWS | Agentic AI | Agile | AngularSenior-level Full TimeGilbert, Arizona, United States; Lake Mary, …10h ago
-
Software Engineer/Researcher, AI-Native Database Systems USD 156K-387KC++ | Database Architecture | Distributed Systems | Indexing | Information RetrievalSenior-level Full TimeSan Jose, California, United States10h ago
-
Software Engineer Level 2 -FFNN-8890 USD 78K-250KAccumulo | BSON | Bigtable | Database Design | Development Lifecycle401k match | Dental insurance | Employee referral programs | Flexible spending accounts | Flexible work arrangementsMid-level Full TimeHanover, MD10h ago
-
Agent architecture | Backend Development | Document ingestion | Frontend Development | IndexingCross-functional collaboration | Hands-on experience | MentorshipEntry-level InternshipSan Jose, California, United States10h ago
-
Apache Flink | Apache Spark | Automation | C++ | Cause analysisSenior-level Full TimeSan Jose, California, United States10h ago
-
Cost estimation | Distributed Caches | Distributed Systems | Document Databases | Embedding IngestionSenior-level Full TimeSeattle, Washington, United States10h ago
-
Agentic data | Apache Hive | Apache Spark | Coding Data | Data CurationSenior-level Full TimeMenlo Park, CA11h ago
-
Cloud Data and AI Engineer, Professional Services USD 127K-183KBigtable | C++ | Cloud Databases | Cloud SQL | Cloud platformTravel up to 30%Mid-level Full TimeReston, VA, USA11h ago
-
Staff Software Engineer, YouTube Ads Machine Learning USD 207K-301KData Processing | Distributed Computing | Embeddings | Fine Tuning | Information RetrievalSenior-level Full TimeMountain View, CA, USA11h ago
-
Research Engineer, Benchmarking, Robotics, DeepMind USD 147K-211KBenchmarking | Data Pipelines | Deep learning | Docker | Embedded deploymentMid-level Full TimeMountain View, CA, USA11h ago
-
Data Engineer USD 123K-151KC++ | Cloud platform | Data Migration | Data Modeling | Data PartitioningBenefits | Hybrid scheduleMid-level Full TimeAustin, TX, USA R11h ago
-
Staff Software Engineer USD 207K-300KAdversarial Testing | C++ | Data pipeline | Learning evaluation | Machine LearningEquity compensation | Health benefits | Hybrid scheduleSenior-level Full TimeNew York, NY, USA R11h ago
-
Senior Software Engineer, Spam and Abuse, AI/ML USD 174K-253KAPI Development | Algorithms | Continuous Deployment | Continuous Training | Data ProcessingSenior-level Full TimeSan Jose, CA, USA11h ago
-
Staff Software Engineer, Cloud SQL, MySQL USD 207K-301KArtificial Intelligence | Cloud Platforms | Data Structures | Data Structures and Algorithms | Database DesignEmployee stock purchase | Health insurance | Paid time off | Retirement plansSenior-level Full TimeSunnyvale, CA, USA11h ago
-
Applied AI ML Researcher Lead USD 177K-215KAblation Testing | Agent systems | Artificial Intelligence | Distributed Computing | Error AnalysisBackup childcare | Financial coaching | Health care coverage | Mental health support | On-site health and wellness centersSenior-level Full TimePalo Alto, CA, United States16h ago
-
AI Research Engineer – Agentic AI USD 165K-180KAblation Studies | Agentic AI | Edge Computing | Error Analysis | Evaluation401k matching | Disability insurance | Health insurance | Life insurance | Paid time offMid-level Full TimeSunnyvale, CA, United States18h ago
-
Senior Machine Learning Engineer, Ad Serving USD 195K-408KContinuous Improvement | Deep learning | Experimentation | Feature Engineering | JavaDisability benefits | Equity awards | Health insurance | Life insurance | Paid time offSenior-level Full TimeNew York, New York18h ago
-
Senior Machine Learning Engineer, Ad Serving USD 195K-352KContinuous Improvement | Deep learning | Distributed Systems | Experimentation | Feature EngineeringCommuter benefits | Dental insurance | Disability benefits | Equity awards | Health insuranceSenior-level Full TimeBoston, Massachusetts18h ago