Conference:  Transform X 2022

Authors: Greg Brockman, Alexandr Wang

2022-10-19

The speaker discusses the potential positive and negative impacts of artificial intelligence and the importance of careful navigation in the field. They emphasize the need for alignment with human values and technical controls to ensure the technology remains in service of humanity.

• AI is a powerful technology that can have both positive and negative impacts
• Misuse and regulation are important considerations in the field
• Technical controls and alignment with human values are necessary to ensure the technology remains in service of humanity
• Building systems that are aligned with human values is a complex problem that requires careful navigation

Conference:  Transform X 2022

Authors: Arvind Neelakantan

2022-10-19

Text embeddings are useful features in many applications including semantic search, predicting code completion, natural language, topic modeling, classification, and computing text similarity. Arvind Neelakantan, Research Lead and Manager at OpenAI, introduces the concept of embeddings, a new terminus in the OpenAI API. When OpenAI originally introduced the API two years ago, it was based on the GPT-3 model, which was useful for many tasks. But, as Neelakantan explains, GPT-3 is not explicitly optimized to produce a single vector or embedding of the input. This ability, to have a condensed representation of the input, would be helpful for programmers and others to use as features for downstream applications, the OpenAI team determined. They set about building an unsupervised model that is good at getting this kind of single embedding, and created a contrastive pre-training model, which Neelakantan will describe. He covers use cases for embeddings, and how the API is used in the real world, including at JetBrains Research for astronomical research and at FineTune Learning, which builds education systems. FineTune is using text embeddings to more accurately find textbook content based on learning objectives.

Conference:  Transform X 2022

Authors: Aidan Gomez

2022-10-19

The speaker discusses the practical applications and limitations of large language models, and emphasizes the importance of making the technology accessible to developers. They also address concerns around bias in data and the need for monitoring and mitigation.

• Large language models can be used for creative applications such as world building in gaming and pro-social technology to create healthier online communities
• The technology requires deep contextual understanding of language and sentiment analysis
• To drive adoption, the interfaces onto the text need to be made easier for developers to use
• Data filtration and monitoring are necessary to mitigate bias and prevent misuse
• The speaker is excited about the potential for models to use tools and references in the world to improve efficiency