Johns Hopkins University, Center for Language and Speech Processing

Dates: Friday, November 15, 2024 – Sunday, November 17, 2024
Location: Johns Hopkins University, Hackerman Hall

SCHEDULE FOR FRIDAY, NOVEMBER 15 | 5:30 PM – 9:00 PM

5:30 PM – 7:00 PM
Welcome Dinner (RSVP Requested to Manage Headcount)

• Location: The Study

7:15 PM – 7:25 PM
Kick-Off and Organizational Information

• Location: Hackerman B17 – Zoom: https://wse.zoom.us/j/96735183473
  • 7:15 – 7:20 PM: Welcome, JSALT 2025 Plans, and Location Information – Honza Černocký
  • 7:20 – 7:25 PM: Meeting Goals, Agenda, and Housekeeping – Sanjeev Khudanpur

7:25 PM – 9:00 PM
“Ice-Breaker” Technical Presentations and Feedback

• Location: Hackerman B17 – Zoom: https://wse.zoom.us/j/96735183473
  • 7:25 – 7:30 PM: Radical Targeted Human Annotation – Corey Miller
  • 7:30 – 7:35 PM: New Approaches for Languages with Growth Opportunities – Kenneth Church
  • 7:35 – 7:40 PM: Faithful Generation of Doctor-Patient Conversations for SLU – Marküs Muller
  • 7:40 – 7:45 PM: Actionable Interpretability of Role-Playing LLMs – Ricard Marxer
  • 7:45 – 7:50 PM: Aligning Foundation Models for Speech and Language – Santosh Kesiraju
  • 7:50 – 7:55 PM: Transparent and Controllable LLM-Based Dialog Systems – Srikanth Madikeri
  • 7:55 – 8:00 PM: Expert-Level Reasoning & Understanding in Audio Processing – Ramani Duraiswami
  • 8:00 – 8:05 PM: Foundation Model for Separating Multitrack Audio Clips – Shijia Liao

8:05 PM – 8:15 PM
Stretch Break (Coffee)

• Location: Hackerman B17 – Zoom: https://wse.zoom.us/j/96735183473

8:15 PM – 9:00 PM
Technical Presentations (Continued)

• Location: Hackerman B17 – Zoom: https://wse.zoom.us/j/96735183473
  • 8:15 – 8:20 PM: Fully Differentiable Multi-Channel, Multi-Talker ASR – Lukáš Burget
  • 8:20 – 8:25 PM: Foundation Model for Conversational Speech Scenarios – Samuele Cornell
  • 8:25 – 8:30 PM: Multimodal Addressee Detection for Multiparty Conversations – Ondřej Klejch
  • 8:30 – 8:35 PM: Speech-to-Text for Low Resource Varieties – David Mortensen
  • 8:35 – 8:40 PM: Phonetic ASR Models for Children with Disabilities – Jinjun Xiong
  • 8:40 – 8:45 PM: Multilingual Speech Analysis for Global Media Monitoring – Yannick Estève

8:50 PM – 9:00 PM
“First Impressions” Feedback for All Potential Ideas

• All Participants

SATURDAY, NOVEMBER 16 | 8:00 AM – 9:00 PM

8:00 AM – 9:00 AM
Continental Breakfast

• Location: Hackerman 3rd Floor

9:00 AM – 9:15 AM
Organizational Discussion

• Location: Hackerman 320  – Zoom: https://zoom.us/j/7232496473
  • 9:00 – 9:05 AM: Summary of Friday’s Presentations and Feedback – Sanjeev Khudanpur
  • 9:05 – 9:15 AM: Decide Breakout Groups & Assign Moderators – All Participants

9:15 AM – 12:30 PM
Technical Deep Dives and Triage (Breakout Sessions)

• Locations: Various Rooms
  • 9:15 – 10:45 AM:
    • Speech Analytics for Multi-talker and Far-Field Scenarios – Hackerman 320 – Zoom: https://zoom.us/j/7232496473
    • Resource Creation for Speech, Text, and Dialog – Hackerman 306 – Zoom: https://zoom.us/j/7337865238
    • Speech Analytics for Low-Resource and Multilingual Scenarios – Hackerman 322 – https://zoom.us/j/6489973816
    • LLM-Based Dialog Generation and Control – Barton 225
    • Audio Analysis and Separation – Hackerman 111 – Zoom: https://zoom.us/j/2782696263

10:45 AM – 11:00 AM
Stretch Break (Coffee)

• Location: Hackerman 3rd Floor

11:00 AM – 12:15 PM
Technical Deep Dives (Continued)

• Locations: Various Rooms
  • 11:00 – 12:15 PM:
    • Speech Analytics for Multi-talker and Far-Field Scenarios – Hackerman 320 – Zoom: https://zoom.us/j/7232496473
    • Resource Creation for Speech, Text, and Dialog – Hackerman 306 – Zoom: https://zoom.us/j/7337865238
    • Speech Analytics for Low-Resource and Multilingual Scenarios – Hackerman 322 – Zoom: https://zoom.us/j/6489973816
    • LLM-Based Dialog Generation and Control – Barton 225
    • Audio Analysis and Separation – Hackerman 111 – Zoom: https://zoom.us/j/2782696263

12:15 PM – 12:30 PM
Triage Guidance Straw Poll

• Focus post-lunch discussions – All Participants

12:30 PM – 1:30 PM
Buffet Lunch

• Location: Hackerman 3rd Floor

1:00 PM – 1:30 PM
Review Straw Poll Results

• Reassign breakout groups if needed – Sanjeev Khudanpur

1:30 PM – 3:00 PM
Technical Improvement and Further Triage (Continued)

• Locations: Various Rooms
  • Breakout Groups:
    • Breakout Group #1 – Hackerman 320 – Zoom: https://zoom.us/j/7232496473
    • Breakout Group #2 – Hackerman 306 – Zoom: https://zoom.us/j/7337865238
    • Breakout Group #3 – Hackerman 322 – Zoom: https://zoom.us/j/6489973816
    • Breakout Group #4 – Barton 225
    • Breakout Group #5 – Hackerman 111 – Zoom: https://zoom.us/j/2782696263

3:00 PM – 3:30 PM
Refreshments + Preparation of Revised/New Presentations

• Location: Hackerman 3rd Floor

3:30 PM – 6:00 PM
Preliminary Evaluation of Revised/New Proposals

• Location: Hackerman 320 – Zoom: https://zoom.us/j/7232496473
  • 3:30 – 3:45 PM: Progress Report from Breakout Groups (3 min each) – Group Moderators
  • Proposal Discussions:
    • 3:45 – 4:00 PM: Proposal A – Proposed Leader A
    • 4:00 – 4:15 PM: Proposal B – Proposed Leader B
    • 4:15 – 4:30 PM: Proposal C – Proposed Leader C
    • 4:30 – 4:45 PM: Proposal D – Proposed Leader D
    • 4:45 – 5:00 PM: Proposal E – Proposed Leader E
    • 5:00 – 5:15 PM: Proposal F – Proposed Leader F
    • 5:15 – 5:30 PM: Proposal G – Proposed Leader G

5:30 PM – 5:40 PM
Explanation of Ranked-Choice Voting System(s)

• Jason Eisner

5:40 PM – 6:00 PM
Time to Reflect and Rank Proposals (Preliminary Vote)

• All Participants

6:30 PM – 9:00 PM
Group Dinner (RSVP Requested)

• Location: Cypriana Restaurant
  • 6:30 – 7:00 PM: Cocktails and Decompression from the Day’s Work
  • 7:00 – 8:45 PM: Sit-Down Dinner
  • 8:45 – 9:00 PM: Summary of Preliminary Vote – Jason Eisner

SCHEDULE FOR SUNDAY, NOVEMBER 17 | 8:00 AM – 1:00 PM

8:00 AM – 9:00 AM
Warm Breakfast

• Location: Hackerman B17 – Zoom: https://wse.zoom.us/j/96735183473

9:00 AM – 9:15 AM
Organizational Discussion and Summary

• Location: Hackerman B17 – Zoom: https://wse.zoom.us/j/96735183473
  • Summary of Saturday’s Presentations and Feedback – Sanjeev Khudanpur

9:15 AM – 12:00 PM
Final Evaluation of Revised Proposals (by Reverse Ranking)

• Location: Hackerman B17 – Zoom: https://wse.zoom.us/j/96735183473
  • 9:15 – 9:30 AM: Discussion of (new | revised) Proposal VI – Proposed leader VI
  • 9:35 – 9:50 AM: Discussion of (new | revised) Proposal V – Proposed leader V
  • 9:55 – 10:10 AM: Discussion of (new | revised) Proposal IV – Proposed leader IV
  • 10:15 – 10:30 AM: Discussion of (new | revised) Proposal III – Proposed leader III
  • 10:35 – 10:50 AM: Discussion of (new | revised) Proposal II – Proposed leader II
  • 10:55 – 11:10 AM: Discussion of (new | revised) Proposal I – Proposed leader I
  • 11:15 – 11:45 AM: General Discussion of All Proposals – All participants
  • 11:45 AM – 12:00 PM: Time to Reflect Upon & Rank All Proposals (Final Vote) – All participants

12:00 PM – 1:00 PM
Farewell Lunch

• Location: Hackerman B17 – Zoom: https://wse.zoom.us/j/96735183473
  • 12:00 – 12:45 PM: Boxed Lunch (suitable for take-away for those departing early) – All participants
  • 12:45 – 1:00 PM: Summary of Final Vote; Next Steps for Highly-Competitive Teams – Sanjeev Khudanpur