OpenAI, :,Aaron Hurst,Adam Lerer,Adam P. Goucher,Adam Perelman,Aditya Ramesh,Aidan Clark,AJ Ostrow,Akila Welihinda,Alan Hayes,Alec Radford,Aleksander Mądry,Alex Baker-Whitcomb,Alex Beutel,Alex Borzunov,Alex Carney,Alex Chow,Alex Kirillov,Alex Nichol,Alex Paino,Alex Renzin,Alex Tachard Passos,Alexander Kirillov,Alexi Christakis,Alexis Conneau,Ali Kamali,Allan Jabri,Allison Moyer,Allison Tam,Amadou Crookes,Amin Tootoochian,Amin Tootoonchian,Ananya Kumar,Andrea Vallone,Andrej Karpathy,Andrew Braunstein,Andrew Cann,Andrew Codispoti,Andrew Galu,Andrew Kondrich,Andrew Tulloch,Andrey Mishchenko,Angela Baek,Angela Jiang,Antoine Pelisse,Antonia Woodford,Anuj Gosalia,Arka Dhar,Ashley Pantuliano,Avi Nayak,Avital Oliver,Barret Zoph,Behrooz Ghorbani,Ben Leimberger,Ben Rossen,Ben Sokolowsky,Ben Wang,Benjamin Zweig,Beth Hoover,Blake Samic,Bob McGrew,Bobby Spero,Bogo Giertler,Bowen Cheng,Brad Lightcap,Brandon Walkin,Brendan Quinn,Brian Guarraci,Brian Hsu,Bright Kellogg,Brydon Eastman,Camillo Lugaresi,Carroll Wainwright,Cary Bassin,Cary Hudson,Casey Chu,Chad Nelson,Chak Li,Chan Jun Shern,Channing Conger,Charlotte Barette,Chelsea Voss,Chen Ding,Cheng Lu,Chong Zhang,Chris Beaumont,Chris Hallacy,Chris Koch,Christian Gibson,Christina Kim,Christine Choi,Christine McLeavey,Christopher Hesse,Claudia Fischer,Clemens Winter,Coley Czarnecki,Colin Jarvis,Colin Wei,Constantin Koumouzelis,Dane Sherburn,Daniel Kappler,Daniel Levin,Daniel Levy,David Carr,David Farhi,David Mely,David Robinson,David Sasaki,Denny Jin,Dev Valladares,Dimitris Tsipras,Doug Li,Duc Phong Nguyen,Duncan Findlay,Edede Oiwoh,Edmund Wong,Ehsan Asdar,Elizabeth Proehl,Elizabeth Yang,Eric Antonow,Eric Kramer,Eric Peterson,Eric Sigler,Eric Wallace,Eugene Brevdo,Evan Mays,Farzad Khorasani,Felipe Petroski Such,Filippo Raso,Francis Zhang,Fred von Lohmann,Freddie Sulit,Gabriel Goh,Gene Oden,Geoff Salmon,Giulio Starace,Greg Brockman,Hadi Salman,Haiming Bao,Haitang Hu,Hannah Wong,Haoyu Wang,Heather Schmidt,Heather Whitney,Heewoo Jun,Hendrik Kirchner,Henrique Ponde de Oliveira Pinto,Hongyu Ren,Huiwen Chang,Hyung Won Chung,Ian Kivlichan,Ian O'Connell,Ian O'Connell,Ian Osband,Ian Silber,Ian Sohl,Ibrahim Okuyucu,Ikai Lan,Ilya Kostrikov,Ilya Sutskever,Ingmar Kanitscheider,Ishaan Gulrajani,Jacob Coxon,Jacob Menick,Jakub Pachocki,James Aung,James Betker,James Crooks,James Lennon,Jamie Kiros,Jan Leike,Jane Park,Jason Kwon,Jason Phang,Jason Teplitz,Jason Wei,Jason Wolfe,Jay Chen,Jeff Harris,Jenia Varavva,Jessica Gan Lee,Jessica Shieh,Ji Lin,Jiahui Yu,Jiayi Weng,Jie Tang,Jieqi Yu,Joanne Jang,Joaquin Quinonero Candela,Joe Beutler,Joe Landers,Joel Parish,Johannes Heidecke,John Schulman,Jonathan Lachman,Jonathan McKay,Jonathan Uesato,Jonathan Ward,Jong Wook Kim,Joost Huizinga,Jordan Sitkin,Jos Kraaijeveld,Josh Gross,Josh Kaplan,Josh Snyder,Joshua Achiam,Joy Jiao,Joyce Lee,Juntang Zhuang,Justyn Harriman,Kai Fricke,Kai Hayashi,Karan Singhal,Katy Shi,Kavin Karthik,Kayla Wood,Kendra Rimbach,Kenny Hsu,Kenny Nguyen,Keren Gu-Lemberg,Kevin Button,Kevin Liu,Kiel Howe,Krithika Muthukumar,Kyle Luther,Lama Ahmad,Larry Kai,Lauren Itow,Lauren Workman,Leher Pathak,Leo Chen,Li Jing,Lia Guy,Liam Fedus,Liang Zhou,Lien Mamitsuka,Lilian Weng,Lindsay McCallum,Lindsey Held,Long Ouyang,Louis Feuvrier,Lu Zhang,Lukas Kondraciuk,Lukasz Kaiser,Luke Hewitt,Luke Metz,Lyric Doshi,Mada Aflak,Maddie Simens,Madelaine Boyd,Madeleine Thompson,Marat Dukhan,Mark Chen,Mark Gray,Mark Hudnall,Marvin Zhang,Marwan Aljubeh,Mateusz Litwin,Matthew Zeng,Max Johnson,Maya Shetty,Mayank Gupta,Meghan Shah,Mehmet Yatbaz,Meng Jia Yang,Mengchao Zhong,Mia Glaese,Mianna Chen,Michael Janner,Michael Lampe,Michael Petrov,Michael Wu,Michele Wang,Michelle Fradin,Michelle Pokrass,Miguel Castro,Miguel Oom Temudo de Castro,Mikhail Pavlov,Miles Brundage,Miles Wang,Minal Khan,Mira Murati,Mo Bavarian,Molly Lin,Murat Yesildal,Nacho Soto,Natalia Gimelshein,Natalie Cone,Natalie Staudacher,Natalie Summers,Natan LaFontaine,Neil Chowdhury,Nick Ryder,Nick Stathas,Nick Turley,Nik Tezak,Niko Felix,Nithanth Kudige,Nitish Keskar,Noah Deutsch,Noel Bundick,Nora Puckett,Ofir Nachum,Ola Okelola,Oleg Boiko,Oleg Murk,Oliver Jaffe,Olivia Watkins,Olivier Godement,Owen Campbell-Moore,Patrick Chao,Paul McMillan,Pavel Belov,Peng Su,Peter Bak,Peter Bakkum,Peter Deng,Peter Dolan,Peter Hoeschele,Peter Welinder,Phil Tillet,Philip Pronin,Philippe Tillet,Prafulla Dhariwal,Qiming Yuan,Rachel Dias,Rachel Lim,Rahul Arora,Rajan Troll,Randall Lin,Rapha Gontijo Lopes,Raul Puri,Reah Miyara,Reimar Leike,Renaud Gaubert,Reza Zamani,Ricky Wang,Rob Donnelly,Rob Honsby,Rocky Smith,Rohan Sahai,Rohit Ramchandani,Romain Huet,Rory Carmichael,Rowan Zellers,Roy Chen,Ruby Chen,Ruslan Nigmatullin,Ryan Cheu,Saachi Jain,Sam Altman,Sam Schoenholz,Sam Toizer,Samuel Miserendino,Sandhini Agarwal,Sara Culver,Scott Ethersmith,Scott Gray,Sean Grove,Sean Metzger,Shamez Hermani,Shantanu Jain,Shengjia Zhao,Sherwin Wu,Shino Jomoto,Shirong Wu, Shuaiqi, Xia,Sonia Phene,Spencer Papay,Srinivas Narayanan,Steve Coffey,Steve Lee,Stewart Hall,Suchir Balaji,Tal Broda,Tal Stramer,Tao Xu,Tarun Gogineni,Taya Christianson,Ted Sanders,Tejal Patwardhan,Thomas Cunninghman,Thomas Degry,Thomas Dimson,Thomas Raoux,Thomas Shadwell,Tianhao Zheng,Todd Underwood,Todor Markov,Toki Sherbakov,Tom Rubin,Tom Stasi,Tomer Kaftan,Tristan Heywood,Troy Peterson,Tyce Walters,Tyna Eloundou,Valerie Qi,Veit Moeller,Vinnie Monaco,Vishal Kuo,Vlad Fomenko,Wayne Chang,Weiyi Zheng,Wenda Zhou,Wesam Manassra,Will Sheu,Wojciech Zaremba,Yash Patil,Yilei Qian,Yongjik Kim,Youlong Cheng,Yu Zhang,Yuchen He,Yuchen Zhang,Yujia Jin,Yunxing Dai,Yury Malkov
OpenAI, :,Aaron Hurst,Adam Lerer,Adam P. Goucher,Adam Perelman,Aditya Ramesh,Aidan Clark,AJ Ostrow,Akila Welihinda,Alan Hayes,Alec Radford,Aleksander Mądry,Alex Baker-Whitcomb,Alex Beutel,Alex Borzunov,Alex Carney,Alex Chow,Alex Kirillov,Alex Nichol,Alex Paino,Alex Renzin,Alex Tachard Passos,Alexander Kirillov,Alexi Christakis,Alexis Conneau,Ali Kamali,Allan Jabri,Allison Moyer,Allison Tam,Amadou Crookes,Amin Tootoochian,Amin Tootoonchian,Ananya Kumar,Andrea Vallone,Andrej Karpathy,Andrew Braunstein,Andrew Cann,Andrew Codispoti,Andrew Galu,Andrew Kondrich,Andrew Tulloch,Andrey Mishchenko,Angela Baek,Angela Jiang,Antoine Pelisse,Antonia Woodford,Anuj Gosalia,Arka Dhar,Ashley Pantuliano,Avi Nayak,Avital Oliver,Barret Zoph,Behrooz Ghorbani,Ben Leimberger,Ben Rossen,Ben Sokolowsky,Ben Wang,Benjamin Zweig,Beth Hoover,Blake Samic,Bob McGrew,Bobby Spero,Bogo Giertler,Bowen Cheng,Brad Lightcap,Brandon Walkin,Brendan Quinn,Brian Guarraci,Brian Hsu,Bright Kellogg,Brydon Eastman,Camillo Lugaresi,Carroll Wainwright,Cary Bassin,Cary Hudson,Casey Chu,Chad Nelson,Chak Li,Chan Jun Shern,Channing Conger,Charlotte Barette,Chelsea Voss,Chen Ding,Cheng Lu,Chong Zhang,Chris Beaumont,Chris Hallacy,Chris Koch,Christian Gibson,Christina Kim,Christine Choi,Christine McLeavey,Christopher Hesse,Claudia Fischer,Clemens Winter,Coley Czarnecki,Colin Jarvis,Colin Wei,Constantin Koumouzelis,Dane Sherburn,Daniel Kappler,Daniel Levin,Daniel Levy,David Carr,David Farhi,David Mely,David Robinson,David Sasaki,Denny Jin,Dev Valladares,Dimitris Tsipras,Doug Li,Duc Phong Nguyen,Duncan Findlay,Edede Oiwoh,Edmund Wong,Ehsan Asdar,Elizabeth Proehl,Elizabeth Yang,Eric Antonow,Eric Kramer,Eric Peterson,Eric Sigler,Eric Wallace,Eugene Brevdo,Evan Mays,Farzad Khorasani,Felipe Petroski Such,Filippo Raso,Francis Zhang,Fred von Lohmann,Freddie Sulit,Gabriel Goh,Gene Oden,Geoff Salmon,Giulio Starace,Greg Brockman,Hadi Salman,Haiming Bao,Haitang Hu,Hannah Wong,Haoyu Wang,Heather Schmidt,Heather Whitney,Heewoo Jun,Hendrik Kirchner,Henrique Ponde de Oliveira Pinto,Hongyu Ren,Huiwen Chang,Hyung Won Chung,Ian Kivlichan,Ian O'Connell,Ian O'Connell,Ian Osband,Ian Silber,Ian Sohl,Ibrahim Okuyucu,Ikai Lan,Ilya Kostrikov,Ilya Sutskever,Ingmar Kanitscheider,Ishaan Gulrajani,Jacob Coxon,Jacob Menick,Jakub Pachocki,James Aung,James Betker,James Crooks,James Lennon,Jamie Kiros,Jan Leike,Jane Park,Jason Kwon,Jason Phang,Jason Teplitz,Jason Wei,Jason Wolfe,Jay Chen,Jeff Harris,Jenia Varavva,Jessica Gan Lee,Jessica Shieh,Ji Lin,Jiahui Yu,Jiayi Weng,Jie Tang,Jieqi Yu,Joanne Jang,Joaquin Quinonero Candela,Joe Beutler,Joe Landers,Joel Parish,Johannes Heidecke,John Schulman,Jonathan Lachman,Jonathan McKay,Jonathan Uesato,Jonathan Ward,Jong Wook Kim,Joost Huizinga,Jordan Sitkin,Jos Kraaijeveld,Josh Gross,Josh Kaplan,Josh Snyder,Joshua Achiam,Joy Jiao,Joyce Lee,Juntang Zhuang,Justyn Harriman,Kai Fricke,Kai Hayashi,Karan Singhal,Katy Shi,Kavin Karthik,Kayla Wood,Kendra Rimbach,Kenny Hsu,Kenny Nguyen,Keren Gu-Lemberg,Kevin Button,Kevin Liu,Kiel Howe,Krithika Muthukumar,Kyle Luther,Lama Ahmad,Larry Kai,Lauren Itow,Lauren Workman,Leher Pathak,Leo Chen,Li Jing,Lia Guy,Liam Fedus,Liang Zhou,Lien Mamitsuka,Lilian Weng,Lindsay McCallum,Lindsey Held,Long Ouyang,Louis Feuvrier,Lu Zhang,Lukas Kondraciuk,Lukasz Kaiser,Luke Hewitt,Luke Metz,Lyric Doshi,Mada Aflak,Maddie Simens,Madelaine Boyd,Madeleine Thompson,Marat Dukhan,Mark Chen,Mark Gray,Mark Hudnall,Marvin Zhang,Marwan Aljubeh,Mateusz Litwin,Matthew Zeng,Max Johnson,Maya Shetty,Mayank Gupta,Meghan Shah,Mehmet Yatbaz,Meng Jia Yang,Mengchao Zhong,Mia Glaese,Mianna Chen,Michael Janner,Michael Lampe,Michael Petrov,Michael Wu,Michele Wang,Michelle Fradin,Michelle Pokrass,Miguel Castro,Miguel Oom Temudo de Castro,Mikhail Pavlov,Miles Brundage,Miles Wang,Minal Khan,Mira Murati,Mo Bavarian,Molly Lin,Murat Yesildal,Nacho Soto,Natalia Gimelshein,Natalie Cone,Natalie Staudacher,Natalie Summers,Natan LaFontaine,Neil Chowdhury,Nick Ryder,Nick Stathas,Nick Turley,Nik Tezak,Niko Felix,Nithanth Kudige,Nitish Keskar,Noah Deutsch,Noel Bundick,Nora Puckett,Ofir Nachum,Ola Okelola,Oleg Boiko,Oleg Murk,Oliver Jaffe,Olivia Watkins,Olivier Godement,Owen Campbell-Moore,Patrick Chao,Paul McMillan,Pavel Belov,Peng Su,Peter Bak,Peter Bakkum,Peter Deng,Peter Dolan,Peter Hoeschele,Peter Welinder,Phil Tillet,Philip Pronin,Philippe Tillet,Prafulla Dhariwal,Qiming Yuan,Rachel Dias,Rachel Lim,Rahul Arora,Rajan Troll,Randall Lin,Rapha Gontijo Lopes,Raul Puri,Reah Miyara,Reimar Leike,Renaud Gaubert,Reza Zamani,Ricky Wang,Rob Donnelly,Rob Honsby,Rocky Smith,Rohan Sahai,Rohit Ramchandani,Romain Huet,Rory Carmichael,Rowan Zellers,Roy Chen,Ruby Chen,Ruslan Nigmatullin,Ryan Cheu,Saachi Jain,Sam Altman,Sam Schoenholz,Sam Toizer,Samuel Miserendino,Sandhini Agarwal,Sara Culver,Scott Ethersmith,Scott Gray,Sean Grove,Sean Metzger,Shamez Hermani,Shantanu Jain,Shengjia Zhao,Sherwin Wu,Shino Jomoto,Shirong Wu, Shuaiqi, Xia,Sonia Phene,Spencer Papay,Srinivas Narayanan,Steve Coffey,Steve Lee,Stewart Hall,Suchir Balaji,Tal Broda,Tal Stramer,Tao Xu,Tarun Gogineni,Taya Christianson,Ted Sanders,Tejal Patwardhan,Thomas Cunninghman,Thomas Degry,Thomas Dimson,Thomas Raoux,Thomas Shadwell,Tianhao Zheng,Todd Underwood,Todor Markov,Toki Sherbakov,Tom Rubin,Tom Stasi,Tomer Kaftan,Tristan Heywood,Troy Peterson,Tyce Walters,Tyna Eloundou,Valerie Qi,Veit Moeller,Vinnie Monaco,Vishal Kuo,Vlad Fomenko,Wayne Chang,Weiyi Zheng,Wenda Zhou,Wesam Manassra,Will Sheu,Wojciech Zaremba,Yash Patil,Yilei Qian,Yongjik Kim,Youlong Cheng,Yu Zhang,Yuchen He,Yuchen Zhang,Yujia Jin,Yunxing Dai,Yury Malkov

GPT-4o is an autoregressive omni model that accepts as input any combination of text, audio, image, and video, and generates any combination of text, audio, and image outputs. It's trained end-to-end across text, vision, and audio, meaning all inputs and outputs are processed by the same neural network. GPT-4o can respond to audio inputs in as little as 232 milliseconds, with an average of 320 milliseconds, which is similar to human response time in conversation. It matches GPT-4 Turbo performance on text in English and code, with significant improvement on text in non-English languages, while also being much faster and 50\% cheaper in the API. GPT-4o is especially better at vision and audio understanding compared to existing models. In line with our commitment to building AI safely and consistent with our voluntary commitments to the White House, we are sharing the GPT-4o System Card, which includes our Preparedness Framework evaluations. In this System Card, we provide a detailed look at GPT-4o's capabilities, limitations, and safety evaluations across multiple categories, focusing on speech-to-speech while also evaluating text and image capabilities, and measures we've implemented to ensure the model is safe and aligned. We also include third-party assessments on dangerous capabilities, as well as discussion of potential societal impacts of GPT-4o's text and vision capabilities.


翻译:暂无翻译

0
下载
关闭预览

相关内容

GPT-4o(“o”代表“omni”)朝着更自然的人机交互迈出了一步——它可以接受任何组合的文本、音频和图像作为输入,并生成任何组合的文本、音频和图像输出。它对音频输入的响应时间最短可达232毫秒,平均为320毫秒,这与人类在对话中的响应时间相似。在英语文本和代码处理上,它的性能与GPT-4 Turbo相当,但在非英语文本处理方面有显著改进,同时在API中速度更快且成本降低50%。与现有模型相比,GPT-4o在视觉和音频理解方面尤其出色。
【ACL2020】多模态信息抽取,365页ppt
专知会员服务
143+阅读 · 2020年7月6日
FlowQA: Grasping Flow in History for Conversational Machine Comprehension
专知会员服务
28+阅读 · 2019年10月18日
Stabilizing Transformers for Reinforcement Learning
专知会员服务
58+阅读 · 2019年10月17日
《DeepGCNs: Making GCNs Go as Deep as CNNs》
专知会员服务
30+阅读 · 2019年10月17日
Keras François Chollet 《Deep Learning with Python 》, 386页pdf
专知会员服务
150+阅读 · 2019年10月12日
【SIGGRAPH2019】TensorFlow 2.0深度学习计算机图形学应用
专知会员服务
39+阅读 · 2019年10月9日
Hierarchically Structured Meta-learning
CreateAMind
25+阅读 · 2019年5月22日
Transferring Knowledge across Learning Processes
CreateAMind
27+阅读 · 2019年5月18日
强化学习的Unsupervised Meta-Learning
CreateAMind
17+阅读 · 2019年1月7日
Unsupervised Learning via Meta-Learning
CreateAMind
41+阅读 · 2019年1月3日
meta learning 17年:MAML SNAIL
CreateAMind
11+阅读 · 2019年1月2日
disentangled-representation-papers
CreateAMind
26+阅读 · 2018年9月12日
STRCF for Visual Object Tracking
统计学习与视觉计算组
14+阅读 · 2018年5月29日
Hierarchical Imitation - Reinforcement Learning
CreateAMind
19+阅读 · 2018年5月25日
Focal Loss for Dense Object Detection
统计学习与视觉计算组
11+阅读 · 2018年3月15日
IJCAI | Cascade Dynamics Modeling with Attention-based RNN
KingsGarden
13+阅读 · 2017年7月16日
国家自然科学基金
1+阅读 · 2015年12月31日
国家自然科学基金
1+阅读 · 2015年12月31日
国家自然科学基金
0+阅读 · 2015年12月31日
国家自然科学基金
0+阅读 · 2015年12月31日
国家自然科学基金
0+阅读 · 2015年12月31日
国家自然科学基金
1+阅读 · 2015年12月31日
国家自然科学基金
2+阅读 · 2015年12月31日
国家自然科学基金
0+阅读 · 2014年12月31日
国家自然科学基金
1+阅读 · 2014年12月31日
国家自然科学基金
0+阅读 · 2014年12月31日
Arxiv
0+阅读 · 10月28日
Arxiv
0+阅读 · 10月26日
Arxiv
0+阅读 · 10月25日
Arxiv
0+阅读 · 10月24日
Arxiv
0+阅读 · 10月23日
Arxiv
0+阅读 · 10月20日
Arxiv
0+阅读 · 10月14日
VIP会员
相关资讯
Hierarchically Structured Meta-learning
CreateAMind
25+阅读 · 2019年5月22日
Transferring Knowledge across Learning Processes
CreateAMind
27+阅读 · 2019年5月18日
强化学习的Unsupervised Meta-Learning
CreateAMind
17+阅读 · 2019年1月7日
Unsupervised Learning via Meta-Learning
CreateAMind
41+阅读 · 2019年1月3日
meta learning 17年:MAML SNAIL
CreateAMind
11+阅读 · 2019年1月2日
disentangled-representation-papers
CreateAMind
26+阅读 · 2018年9月12日
STRCF for Visual Object Tracking
统计学习与视觉计算组
14+阅读 · 2018年5月29日
Hierarchical Imitation - Reinforcement Learning
CreateAMind
19+阅读 · 2018年5月25日
Focal Loss for Dense Object Detection
统计学习与视觉计算组
11+阅读 · 2018年3月15日
IJCAI | Cascade Dynamics Modeling with Attention-based RNN
KingsGarden
13+阅读 · 2017年7月16日
相关论文
Arxiv
0+阅读 · 10月28日
Arxiv
0+阅读 · 10月26日
Arxiv
0+阅读 · 10月25日
Arxiv
0+阅读 · 10月24日
Arxiv
0+阅读 · 10月23日
Arxiv
0+阅读 · 10月20日
Arxiv
0+阅读 · 10月14日
相关基金
国家自然科学基金
1+阅读 · 2015年12月31日
国家自然科学基金
1+阅读 · 2015年12月31日
国家自然科学基金
0+阅读 · 2015年12月31日
国家自然科学基金
0+阅读 · 2015年12月31日
国家自然科学基金
0+阅读 · 2015年12月31日
国家自然科学基金
1+阅读 · 2015年12月31日
国家自然科学基金
2+阅读 · 2015年12月31日
国家自然科学基金
0+阅读 · 2014年12月31日
国家自然科学基金
1+阅读 · 2014年12月31日
国家自然科学基金
0+阅读 · 2014年12月31日
Top
微信扫码咨询专知VIP会员