Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Searching for Needles in a Haystack: On the Role of Incidental Bilingualism in PaLM’s Translation Capability

Hiroyuki Deguchi
October 03, 2023
Research
0
34

Searching for Needles in a Haystack: On the Role of Incidental Bilingualism in PaLM’s Translation Capability

Hiroyuki Deguchi

October 03, 2023
Tweet

More Decks by Hiroyuki Deguchi

See All by Hiroyuki Deguchi
Paper Reading: Sampling-Based Approximations to Minimum Bayes Risk Decoding for Neural Machine Translation
de9uch1
0
60
My Research Environmental Setup
de9uch1
0
140
Nearest Neighbor Machine Translation
de9uch1
0
140
Paper Reading - Dynamic Programming Encoding for Subword Segmentation in Neural Machine Translation
de9uch1
0
190
paper reading - Tree Transformer
de9uch1
0
120
Dependency-Based Self-Attention for Transformer NMT (RANLP2019)
de9uch1
0
30

Other Decks in Research

See All in Research
DroidKaigi2023 突撃！隣のコードレビュー
satotaichi
0
1.2k
20230923_Kaggler_meetup_LT_ya9do.pdf
ya9do
2
1.1k
クロスモビリティプロジェクト【最新版】
smartfukushilab1
0
160
Hand Rehabilitation Lab Research Projects
ahspragu
0
260
Synthetic Control Methods through Predictive Synthesis
masakat0
0
110
旅行記から地図へ：文章から旅の軌跡を取り出して地図上に描く
hiroki13
0
110
LLMとプランニングの未来
smatsumori
1
200
Improving LaCAM for Scalable Eventually Optimal Multi-Agent Pathfinding
kei18
0
320
What Are You Token About? Dense Retrieval as Distributions Over the Vocabulary
ryou0634
0
250
Unisim 超リアルな自動運転センサシミュレーション
abemii
1
670
Learn Continuous Structure
eqpresents
0
2.5k
[CVPR 2023 論文紹介] Unifying Vision, Text, and Layout for Universal Document Processing / kanto-cv-59-udop
shimacos
2
400

Featured

See All Featured
Ruby is Unlike a Banana
tanoku
93
9.9k
How to name files
jennybc
57
85k
Happy Clients
brianwarren
92
6.1k
How GitHub Uses GitHub to Build GitHub
holman
467
280k
Atom: Resistance is Futile
akmur
257
24k
ピンチをチャンスに：未来をつくるプロダクトロードマップ #pmconf2020
aki_iinuma
44
25k
Making the Leap to Tech Lead
cromwellryan
119
8.1k
Building an army of robots
kneath
300
41k
Creating an realtime collaboration tool: Agile Flush - .NET Oxford
marcduiker
10
1.2k
VelocityConf: Rendering Performance Case Studies
addyosmani
318
23k
Build your cross-platform service in a week with App Engine
jlugia
223
17k
The Illustrated Children's Guide to Kubernetes
chrisshort
26
45k

Transcript

  1. View Slide

  2. ◼ [1]
    ◼
    ◼
    ◼
    [1] PaLM: Scaling Language Modeling with Pathways (Chowdhery+, JMLR vol.24, no.240, 2023)

    View Slide

  3. [1]
    ◼
    ◼
    ⚫
    ⚫
    ⚫
    ⚫
    ◼
    ◼
    [1] PaLM: Scaling Language Modeling with Pathways (Chowdhery+, JMLR vol.24, no.240, 2023)

    View Slide

  4. ◼
    ⚫
    ⚫
    ◼
    ⚫
    ⚫
    ▶
    ▶

    View Slide

  5. ◼
    ⚫
    ⚫ [2]
    ⚫ [2]
    ◼
    ⚫
    ⚫
    [2] Language-agnostic BERT Sentence Embedding (Feng+, ACL2022)

    View Slide

  6. ◼
    ⚫
    ⚫

    View Slide

  7. ◼
    ⚫
    ◼ ◼

    View Slide

  8. ◼
    ◼
    ◼

    View Slide

  9. ◼
    ⚫
    ▶
    ▶
    ⚫
    ⚫
    ◼
    ⚫
    ▶

    View Slide

  10. ◼
    ⚫
    ⚫
    ⚫
    ▶
    ▶
    ▶

    View Slide

  11. ◼
    ⚫
    ⚫
    ▶
    ▶

    View Slide

  12. ◼
    ⚫
    ▶
    ▶
    ◼
    ⚫
    ⚫
    ▶
    ⚫

    View Slide