- Top
- Job Listings
- Data Engineer
JOB ID 25260
Data Engineer
- Logistics & Transportation, Transportation, Trafic
- IT, Data Analyst
- Tokyo
- ¥7,000,000~¥12,000,000
It is a company that develops mobility-related services and promotes the digitalization of transportation and transportation.
In addition to developing a variety of services using its own apps and platforms, mainly taxi dispatch services, it
is also one of only a dozen unicorn companies in Japan, and is co-creating new mobility services with various companies.
This position is a data engineer for the company-wide data infrastructure. Collect necessary data from inside and outside the company and accumulate it in the data platform. We support the utilization of data across the company by providing data modeling and analysis tools based on utilization needs.
Job Description
-
- Responsibilities
- ■Data generation and collection
- Designed to output the data required for analysis to the application log. Log output, log collection
- Collect data from the user's device or in-vehicle device.
- Data collection from operational databases.
- External data collection.
■Data accumulation
- Accumulated in Google Cloud's BigQuery, which is the company-wide data platform. management.
■ Create a data mart
- Data modeling according to the requirements of the analysis. Create a data mart.
- Development
of "LookML", a semantic layer of the BI tool Looker - Construction
of data processing pipelines using Google Cloud's dataform, Airflow (Cloud Composer), etc. - Production operation of data marts and semantic layers. Data quality monitoring.
■Activities
for data utilization - Provision
of analysis tools (Looker, Streamlit, etc.) for data utilization - Development of metadata
- Formulation of usage rules for data governance
-
- Requirements
- ・More than 3 years
of experience in system operation and maintenance on the backend and server-side of commercial systems, more than 1 year of experience
in operating and maintaining the same system, and more than 3 years of experience in team development. Experience in PR-based development
using Git, more than 1 year of experience in batch
processing using job controllers and workflow engines such as Airflow, and more than 1 year of experience in developing SQL for analysis (e.g., KPI monitoring, effect verification
through A/B testing, and table design). Understanding and Practice Table Normalization. Experience
in table design for systems consisting of 10 or more table counties, experience
in using data warehouse products such as BigQuery, Snowflake, or RedShift, experience in building
systems in Google Cloud or AWS, and experience in connecting to BI tools
-
- Preferred
- ・Experience
in data platform development and operation, experience in using Looker, experience in connecting data
, experience in
using Airflow (Cloud Composer), experience in
using SQL frameworks such as Dataform and dbt, experience in using
Google Analytics, Adjust, Karte, etc. ・Experience
in project management work・Advanced SQL development (using windows functions, geospatial queries, etc.)
・Possess
a qualification with a difficulty level higher than the retribution information processing test ・Possess
a Google Cloud qualification ■Desired personality:
・Those
who regard technology as a means and can prioritize business contribution rather than technical refinement. ・Those who
can think logically ・Those who can respond flexibly not only to regular work but also to irregular work and to work while having fun
-
- Location
- Tokyo
-
- Work Style
- Remote working possible, Flex working possible
-
- Salary
- ¥7,000,000~¥12,000,000
-
- Attractive
Points - No relocation, Childcare support system, Weekends and holidays off, New businesses and services
- Attractive
Consultation
Our expert team is dedicated to empowering your career change, crafting tailored career plans, and securing the best job opportunities in the automotive and mobility sectors.
Search by Industry
Search by Job Type
Search by Location
- Top
- Job Listings
- Software Development Engineer