AIToday
Large Language ModelsQiita 機械学習Published: Nov 6, 2026, 13:00 JST

Shared Transformer trained jointly on 浅間下交差点周辺 and 川崎市立幸高校周辺 road networks

Send on LINE
Shared Transformer trained jointly on 浅間下交差点周辺 and 川崎市立幸高校周辺 road networks

3 Key Points

  1. What happened

    Using data from 浅間下交差点周辺 (122 nodes) and 川崎市立幸高校周辺 (126 nodes), the author alternately fed each network's batches into one Shared Transformer, keeping graph, position and fully-connected layers per network, and saw both networks' prediction accuracy hold or improve slightly.

  2. Why it matters

    The result suggests a single Transformer can learn traffic-flow features common to multiple road networks, potentially removing the need to train a separate Transformer for each network, though the author frames this as a possibility.

Not sure about something? Ask the AI

Questions and answers are published on this page.

Summaries like this, every morning.

Context & Analysis

This is the fifth installment in a series that builds traffic-flow prediction models from OpenStreetMap data and the UXsim simulator. Earlier rounds established a model for the 浅間下交差点周辺 area, tried transfer learning to a different network around 川崎市立幸高校, and then prototyped a multi-network model where one Transformer is shared across networks. That earlier shared model, however, had been trained only on 浅間下交差点周辺 data and simply reused for the other network. The new step is to actually train the Shared Transformer on both networks' data together. The author kept graph, position and fully-connected layers per network and shared only the Transformer and LayerNorm, starting from the previously trained weights. Because the two networks differ in size — 122 versus 126 nodes — a concern was that adapting too much to one network could degrade the other. The experiment did not show that degradation, which the author reads as a hint that the shared model is picking up traffic-flow patterns common to both networks rather than just each network's individual quirks. The next planned step is Batch Inference, processing multiple road networks in a single batch.

FAQ
How were the two road networks trained together?
The author alternately fed batches from 浅間下交差点周辺 and 川崎市立幸高校周辺 into the same Shared Transformer, updating it based on each network's loss in turn.
Did joint training hurt accuracy on either network?
No. Compared with the previous round, prediction performance was maintained or slightly improved for both networks, with MAE and RMSE both improving slightly.
What part of the model is shared and what stays per network?
The Shared Transformer and LayerNorm are shared, while GraphEmbedding, PositionEmbedding and the fully-connected layers are kept per road network.
Qiita 機械学習Read Original Article
Send on LINE

AI news that matters for your work, delivered every morning.

Pick your industry and the AI tools you use, and get news related to your work every day.

Free · 30 seconds with Google · unsubscribe anytimeWhat is AIToday? →

Ask AI

Ask AI anything about this article. The AI reads this article, earlier AIToday articles, and Wikipedia, and cites its sources. Q&As are published on this page for other readers too.

Questions and answers are published on this page.

Related Articles

Next articleClaude adds read-only Personal Finance for US Pro, Max, Ultra users