- Top
- Job Listings
- Data Engineer (ML Engineer) | Data Engineer (ML Engineer)
JOB ID 27447
Data Engineer (ML Engineer) | Data Engineer (ML Engineer)
- Logistics & Transportation, Transportation, Trafic
- IT, Data Analyst
- Tokyo
- ¥8,000,000~¥12,000,000
It is a company that develops mobility-related services and promotes the digitalization of transportation and transportation methods.
Utilizing its proprietary apps and platforms, it offers a variety of services centered on taxi dispatch services. As
one of only a dozen or so unicorn companies in Japan, it co-creates new mobility services with various companies.
This is a data engineer position that supports the data infrastructure that collects and utilizes data on the scale of 1 billion records daily. You will be responsible for the data infrastructure and the execution platform for data products.
Job Description
-
- Responsibilities
- ■ Data Platform
: Large-scale vehicle data collected
in BigQuery using tools like Dataflow, database data from 35 million downloads of applications and logs in
BigQuery, external data such as maps collected
on the data platform, data processing batch development and operation, and various Google Cloud services Implementing
services ・Hosting
analytics tools such as Streamlit and Looker ・Managing about 100 users and security controls
■ Data product execution platform
・Designing, developing, and operating
a data product execution platform using AI and advanced algorithms with the taxi app 'GO' ・Development support
for data scientists ・Training batch AI models and inference service
in production ・Design, implementation,
and system operation to ensure high performance and availability ・24/365 on-call system (no standby; calls are available in turn during system failures)
[Development environment]
■ Data Platform
・Data Store: BigQuery
・ETL: Dataflow, proprietary development (Python)
・SQL framework: Dataform
・Workflow engine: Cloud Composer (Airflow) + GKE
・Metadata management: Dataplex
・Other tools: Streamlit, Kepler.gl, Kubeflow
・Language: Python
■ Data Product Execution Platform
・Data stores: Redis, AWS Aurora (MySQL, PostgreSQL)
・Execution platform: AWS: AKE, etc.
・Languages: Go, Python
・Monitoring: Grafana, Sentry
・Other tools: Feast
■ Development Environment
・LLM: Github Copilot, Claude code, gemini, MCPs, etc.
・IDE: VS Code, etc.
・CI / CD: GitHub Action
・VCS: GitHub
・Others: Google Workspace, Slack
-
- Requirements
- Over three years of experience
in the following items: full-scale operation of commercial systems, failure management
, development
using RDBMS, development in
GO language or Python, batch development
using job controllers (such as Airflow), development on
Google Cloud or AWS, development with Linux or Docker.
・PR-based development using Git
At least one year of experience
in the following items, experience developing
resident processes such as web apps and APIs, and experience handling performance issues. Ability to
identify bottlenecks such as CPU, memory, IO, and network - Reviewing others' code
Experience independently discovering and solving
issues in a lead system of three or more
people. Japanese proficiency (native or business level).
-
- Preferred
- ・Experience
using data warehouses (BigQuery, Snowflake, etc.) ・Experience developing
machine learning training batches and inference batches ・Experience managing Google Cloud or holding SRE positions, holding Google Cloud certifications
・Holding applied information technology certification
and computer science degree
-
- Location
- Tokyo
-
- Work Style
- Remote working possible, Flex working possible
-
- Salary
- ¥8,000,000~¥12,000,000
-
- Attractive
Points - No relocation, Weekends and holidays off, Major corporation
- Attractive
Consultation
Our expert team is dedicated to empowering your career change, crafting tailored career plans, and securing the best job opportunities in the automotive and mobility sectors.
Search by Industry
Search by Job Type
Search by Location
- Top
- Job Listings
- Data Scientist (for Four-Wheel Business)|Data Scientist (for Four-Wheel Business)