FM+SE Summit 2024

Tokyo Hilton Bay - March 28 and 29, 2024

About Program Registration Venue Sponsors Contact

Join us to explore and define the future of Software (i.e., AIware) in the Foundation Models era of AI as well as the future of Software Engineering with FMware (i.e., FM-powered AIware).

On March 30 we will have an excursion to enable stronger community building and bird-of-feather discussions (must register by March 1st) - limited availability for the excursion as the spots might run out.

About the event

“Software for all and by all” is the future of humanity. AIware, i.e., AI-powered software, has the potential to democratize software creation. We must reimagine software and software engineering (SE), enabling individuals of all backgrounds to participate in its creation with higher reliability and quality. Over the past decade, software has evolved from human-driven Codeware to the first generation of AIware, known as Neuralware, developed by AI experts. Foundation Models (FMs, including Large Language Models or LLMs), like GPT, ushered in software's next generation, Promptware, led by domain and prompt experts. However, this merely scratches the surface of the future of software. We are already witnessing the emergence of the next generation of software, Agentware, in which humans and intelligent agents jointly lead the creation of software. With the advent of brain-like World Models and brain-computer interfaces, we anticipate the arrival of Mindware, representing another generation of software. Agentware and Mindware promise greater autonomy and widespread accessibility, with non-expert individuals, known as Software Makers, offering oversight to autonomous agents.

The SE community will need to develop fundamentally new approaches and evolve existing ones, so they are suitable for a world in which software creation is within the reach of Software Makers of all levels of SE expertise, as opposed to solely expert developers. We must recognize a shift in where expertise lies in software creation and start making the needed changes in the type of research that is being conducted, the ways that SE is being taught, and the support that is offered to software makers.

To register for the event, please follow this link. The event will be held on March 28 and 29 at the Tokyo Hilton Bay Hotel. On March 30 we will have a community excursion to enable stronger community building and extensive discussions. You must register by March 1st to join the execution and do note that excursion has limited availability so the spots might run out even before March 1st.

Unfortunately, we are not able to provide invitation letters for Japan visas at this time. However, please check the Japanese embassy in your country as nationals from many countries might not require one.

Why attend?

The impact of Foundation/Large Models (FM) on the Software Industry and on Software Engineering (SE) is breathtaking, especially given the rapid and impactful progress in this nascent field. FMs promise to dramatically change and improve how we develop software (FM4SE) as well as the actual definition of software and the software engineering needs for this new nascent field itself (SE4FM). Join us to explore and define the future of Software (i.e., AIware) in the Foundation Models era of AI as well as the future of Software Engineering with FMware (i.e., FM-powered AIware).

As academics and practitioners alike need to prepare for the FM revolution, it is critical that we kickstart a global dialogue on important strategic future directions and challenges, on important community-wide initiatives and on the shape of Software and SE in the next few years. Such a dialogue requires close interactions between industry and academia.

Furthermore, young professionals and researchers require training in state-of-the-art and state-of-the-future techniques and insights that will guide the future of FM4SE and SE4FM.

The FM+SE Summit will provide lectures and panels by leading industrial and academic experts.

The FM+SE Summit is part of a larger effort of the Software Engineering (SE) community to rethink SE in the era of Foundational Models.

  1. In 2023, the FM+SE Vision 2030 aimed to jumpstart the AIware community. And the turnout was fantastic! We had 108 attendees (57 from industry and 51 from academia), plus 50+ folks joining in via Zoom. It was a mix of a Dagstuhl with deep discussions and a school with great tutorials and industrial keynotes (around 4 tracks in parallel for two days). The active involvement of industry professionals brought a real-world perspective to the discussions, touching on the genuine pain points faced by practitioners today. Feel free to check out the program, the event recap video and our group photo.
  2. We have recently established a Steering Committee of Industry and Academic leaders on this topic.
  3. A Shonan on Foundation Models and Software Engineering: Challenges and Opportunities.
  4. A new International ACM Conference on AIware to be held in July 2024. Please consider submitting your academic work or industry perspectives to the AIware Conference!

Program

Introduction

Summit Opening and Community Update [30 mins]

  • Zhen Ming (Jack) Jiang
    York University, Canada
  • Yasutaka Kamei
    Kyushu University, Japan
  • Ahmed E. Hassan
    Queen’s University, Canada

IEEE 2024 Technology Predictions Update [20 mins]

  • Hironori Washizaki
    IEEE Computer Society President, Waseda University, Japan

Standardization and SWEBoK Efforts [10 mins]

  • Zhen Ming (Jack) Jiang
    York University, Canada

Break

Rethinking Software and SE in the FM Era

  • Software Development Lifecycle in the Era of Foundation Models [25 mins]
    Ipek Ozkaya
    Software Engineering Institute (SEI), Carnegie Mellon University (CMU), USA and Most Recent Editor in Chief of IEEE Software (the most prominent magazine for software practitioners)
  • Rethinking Software Engineering in the FM Era [25 mins]
    Dayi Lin
    Huawei, Canada

Chair: Emad Shihab, Concordia University


Panel A: Impact of Foundation Models on Developer Productivity [70 mins]

  • Satish Chandra, Google, USA
  • Ipek Ozkaya, SEI, CMU, USA, IEEE Software EiC
  • Nachi Nagappan, Meta, USA
  • Dayi Lin, Huawei, Canada
  • Denys Poshyvanyk, William and Mary, USA
  • Alexander Serebrenik, Eindhoven University of Technology, Netherlands

Moderator: Ahmed E. Hassan, Queen's University

Lunch

AIware in Industrial Setting: Challenges and Success Stories

  • Establishing Trust between Developers and Co-pilot [30 mins]
    Thomas Zimmermann
    Microsoft and ACM SIGSOFT President, USA
  • Machine Learning for Software Engineering [30 mins]
    Satish Chandra
    Google, USA

Discussion [30 mins]

Chair: Yasutaka Kamei, Kuyushu University

Break

AIware for Code Generation and Beyond

  • Source Code Is All You Need [18 mins]
    Lingming Zhang
    University of Illinois, USA
  • Interpretability of the Code Generation Process of LLMs [18 mins]
    Denys Poshyvanyk
    William and Mary, USA
  • Generating Code for Complex Code Bases [18 mins]
    Emad Shihab
    Concordia University, Canada
  • Testing the Limits: What Breaks and How to Partially Fix LLM4ASE? [18 mins]
    David Lo
    Singapore Management University, Singapore
  • Do language models really understand code? [18 mins]
    Romain Robbes
    Laboratoire Bordelais de Recherche en Informatique, France

Discussion [30 mins]

Chair: Zhen Ming (Jack) Jiang, York University

Dinner reception

AIware in SE context: Opportunities and Challenges

  • Towards Code-Aware Code Models [30 mins]
    Baishakhi Ray
    Columbia University and Amazon Web Services, USA
  • LLMs Applied to Traditional Software Engineering Problems [30 mins]
    Nachi Nagappan
    Meta, USA

Discussion [30 mins]

Chair: Cor-Paul Bezemer, University of Alberta

Break

FM-generated Code and FMware

  • Examination of the Reliability of Generated LLM code [15 mins]
    Foutse Khomh
    IVADO and Polytechnique Montréal, Canada
  • Security and Runtime Performance of Code Generated by GitHub Copilot [15 mins]
    Mei Nagappan
    University of Waterloo, Canada
  • Towards Trustworthiness Assurance of Data-driven AI in the Language Model Era [15 mins]
    Lei Ma
    Tokyo University, Japan and Amii, University of Alberta, Canada
  • FM-related Progress of the work of the Quality Assurance for AI working group (QA4AI) [15 mins]
    Fuyuki Ishikawa
    Deputy Director of Grace Center, National Institute of Informatics (NII), Japan

Discussion [30 mins]

Chair: Weiyi Shang, University of Waterloo

Lunch

Applications of AIware in SE Context

  • Visual Software Quality Assurance Using LLMs [15 mins]
    Cor-Paul Bezemer
    University of Alberta, Canada
  • Use of LLMs to Support the Development Process at Denso Japan [15 mins]
    Hiroki Takamoto and Rieko Takagi
    Denso Group, Japan
  • Software Design Review Using LLMs at Fujistu [15 mins]
    Susumu Tokumoto and Takasaburo Fukuda
    Fujitsu, Japan
  • Automated Software Testing Using LLMs [15 mins]
    Lionel Briand
    Lero, Ireland and University of Ottawa, Canada

Discussion [30 mins]

Chair: Lei Ma, University of Tokyo, Amii, University of Alberta

Break

Panel B: Impact of Foundation Models on Software Quality [90 mins]

  • Lionel Briand, Lero, Ireland and University of Ottawa, Canada
  • Ipek Ozkaya, SEI, CMU, USA
  • David Lo, SMU, Singapore
  • Foutse Khome, IVADO and Ecole Polytechnique, Canada
  • Lei Ma, University of Tokyo, Japan and Amii, University of Alberta, Canada

Moderator: Dayi Lin, Huawei


Closing [30 minutes]

Excursion and bird-of-feather meetings

Excursion Itinerary: teamLab Planets & Ueno Park

  • 9:00am: Departure from Hilton by bus to teamLab Planets.
  • 9:30-11:30am: Visit teamLab Planets: Experience immersive digital art installations and interactive exhibits.
  • 11:30am: Departure from teamLab Planets by bus to Ueno Park.
  • 12:00-1:30pm: Explore Ueno Park and Ueno Toshogu and enjoy the cherry blossoms (Sakura), cultural insights, and scenic views.
    • Participants can choose to have lunch on their own in the vicinity.
    • Those who wish to extend their stay in Ueno Park can do so, with flexibility.
  • 1:30pm: End of organized activities.


Limited spots available

Self-organized bird-of-feather meetings




Registration

Registration:

The event costs $350 USD for students and $550 USD for professors and researchers. The cost is $650 USD for industry affiliated individuals.

Industry registration/sponsorship:

$1,000 USD sponsorship would provide one FREE registration as well as logo and acknowledgement on all event material and website. Please contact us if your organization wishes to send several individuals as we would offer a reduced rate, however, please keep in mind that space is quite limited and we wish to provide access to a wider range of groups.

Registration process:

Due to limited spots, please express your interest to register at this link by March 1st, 2024. Notification will be sent out by no later than March 2nd, 2024 with a link to register and pay your registration. You then have one week to pay your registration fee otherwise we will remove your spot to another participant in the waiting list.

Accommodation:

Participants are expected to arrange their own accommodations. There are many hotels around the Hilton, in addition to the Hilton itself, which has ample room availability at this moment.

Japan VISA:

**NEW** We are now able to request Japan visa invitation letters for registered paid attendees. Once the letter request is approved, we will share the letter asap with you. Please indicate if you will need a visa invitation letter when registering. Please check the Japanese embassy in your country as nationals from many countries might not require one.

Event Venue

Hilton Tokyo Bay

1-8 Maihama, Urayasu, Chiba
279-0031,
Tokyo, Japan
Website

Sponsors

(pending)

Contact Us

If you have any questions or concerns, do not hesitate to contact us. We hope you can join us in Tokyo this March to plan the FM future of the Software Industry and Software Engineering!


Organizers

Ahmed E. Hassan, Fellow of ACM/IEEE/NSERC Steacie, Queen’s University
Zhen Ming (Jack) Jiang, York University
Yasutaka Kamei, Kyushu University


Local arrangement chairs

Yutaro Kashiwa, NAIST
Masanari Kondo, Kyushu University