Transcripts For SFGTV APEC 20240706

Economies. In San Francisco, we have the spirit to take risks, to seek out whats new and different. We search for the next great idea. We dont just have the dreamers who look beyond whats possible, but we also have the builders with the talent to make the dream a reality. For decades, the San Francisco bay area has provided added the culture, the talent and the spirit to change the world. The spirit of apec, of finding Common Ground and of power, of economic collaboration , and of celebrating diverse cultures, reflects that same spirit of innovation. It is a spirit that has driven San Francisco and the bay area to become the economic engine of the world. It is the spirit that will continue to propel businesses from across the Asia Pacific Region to be part of what is happening right here, right now. We are in the spring of yet another innovative boom in San Francisco, driven by the rapid rise of Artificial Intelligence science. We have more ai job openings of any major city in the country. Of the top 20 ai companies in the world, eight are located right here in San Francisco. The conversations happen in this city and the conversation is happening here today. These these are the ideas that are going to transform our world in the decades to come. Future generations will look back on these discussions as the start of something in entirely new and its happening all right here in San Francisco. It economies, industry and Society Change rapidly. We google was started out of a garage down highway 101 freeway meadow was a website for rating classmate appeared agencies openai was virtually unheard of last year at this time. Now chatgpt has 100 million users. Google has over a billion users and meta has over 3 billion users. The entire world is using products imagined and built out right here to discuss all of this, we are going to hear about the future of ai from former secretary of state john kerry and salesforce ceo marc benioff, whose companies have been a leader in our city and in efforts to transform the world through innovation in. But first, it is my pleasure to introduce the next panel, a Group Representing the very best of how we dream in San Francisco. So people who take time to listen for new ideas, who envision what that idea can become, who creates successful and thriving businesses, but also make life better for people around the globe. Please join me in welcoming Laurie Powell jobs of the emerson collective. Chris cock of meta, James Manyika of google and sam altman of open ai. Okay i feel like you guys are a little far away. Did we bunch up . It does feel a little far. Does it feel free to gather in for our for our conversation foreign hi everyone. Good afternoon. I am very very pleased to be here at and hosting the discussion of one of the most important topics in technology and around the world. Artificial intelligence. The era of generative ai is moving at breathtaking pace, making step function changes rapidly in a short amount of time. Its an astonishing time to be alive, and it feels different from other disruptive technologies. This year alone, design discussions have ranged from some possibilities of apoc elliptic doom to the exhilarating promise of unprecedented advancements. As these technologies are speaking and conversing with us, creating images and challenging our understanding of human intent emergence. However many questions remain around around how we can best utilize these ai as humans for the good of humanity and to craft a future thats equitable, responsible and aligned with our core values. To discuss this critical topic, as the mayor said, were fortunate to be joined today by three of the worlds leading thinkers and developers of ai chris cox, chief product officer of meta. James manyika, googles svp of Research Technology and society, and sam altman, ceo of openai. Lets give them a warm welcome. Well, colleagues, ai is a wondrous technology fauci researchers are using ai to create new proteins and discover new drugs. Ai tutors may transform the way that children are educated. Their their potential financial, male workforce and climate benefits that we can imagine and those that we cant imagine. And there are risks. But before we get into the existence, risks and the Regulatory Environment that wed all like to see, id like to begin the conversation with looking through your eyes for a minute. Chris james and sam, why are you devoting your life to this work . We can start with any of you, but since i can see you. Chris yeah, im happy to start. I mean, its funny. I started studying ai back in 2001 and back when i was a lot more arcane of a science than i think it is today. Yeah. And i remember being first attracted to it because. Because it felt to me like our ability to understand learning would help us understand ourselves. Would help us understand how we learn in our own consciousness and part of whats been so interesting about it today is that the technology thats allowing ai to start to be really good is modeled after the way our minds work. You know, you dont teach a kid, i have two little kids, like you dont teach a kid. This is a noun and this is a verb and this is how you put a prepositional phrase together. You just speak to them and they learn through experiencing the world. Yeah. And i think part of why this is such an exciting period for ai is were starting to see that the technologies were building are start to become a little bit closer to the way we learn, which is through exposure to one another. And by building them that way. I believe has the promise of making the technology really humane and really modeled after the way that we interact with the world in our own judgments about whats right and wrong and our own judgments about what feels good and what doesnt feel good. So i think over the years weve come to a pretty neat place. And like you said, i think we all feel the sort of the excitement, but also at the same time, the importance of discipline and seriousness about making sure that the way we usher it into the world is responsible. Yeah of course. And for you, is this because its been a 20 year period for you . Focus on this is this to you your lifes work . Its certainly what ive spent the most of my life on. I mean, i started at facebook back in 2005, so i was one of our, i think, 13 engineers or 14th engineers. And most of my work there has been in trying to Design Software that gives people the content they care about that connects them to their friends and family. And if you go back to at least to our company history, i think similar to google, the fundamental innovation was really about getting good at recommending content for each person, personalizing content, understanding vast amounts of data, helping each person get uniquely the stuff they care about. And so for me, that was i that was sort of behind the scenes that was really important. And part of whats starting to happen now is people are becoming, i think, having contact with it by talking to it. I think thats part of what chatgpt brought us for the first time is like, oh, now i can talk to it. Yeah and i think that embodiment is part of what sort of like taking this tech thats been around for a little while and suddenly giving it a mode of interacting with with each other. Yeah. Hey, james, what about you . And you. You actually came. You were studying ai and went to mckinsey and then decided to make a real career pivot. Well, its wonderful to be here with sam and chris and you, laurene, as always, im looking forward to the conversation. For me, laurene, the very first thing i ever published in my whole life was in 1992. I was an undergraduate. It was a paper on training and modeling neural networks. That was the first thing i ever published in my whole life. I then went on after that to do a phd in ai and robotics at oxford and at the time, by the way, it was a very different time for the field. My advisors actually advised me not to put the word ai in my dissertation because no one would take me seriously. So we called it something else. But when i look back from that time to where we are, are the progress has been extraordinary. Its been extraordinary. We, you know, in the intervening time i was at mckinsey looking at these big problems in society, key things about economic growth, productivity, anti Climate Change and so forth. So part of what was realizing that i actually has a possibility of helping us to tackle all of these things. So what i get very excited and when i think about the work were doing at google, for example, you know, there are several areas that kind of motivate me, excite us. The possibility of actually helping people in very assistive ways. Do some of the most imaginative, creative endeavors, learn languages, speak languages, get past access barriers, linguistic difficulty. I will help with that. Yeah. The possibility that in fact we could actually transform economy is all the stuff that i spend my time Mckinsey Global institute thinking about productivity growth, expanding Prosperity Party how do we Power Company size economies, sectors. I will help with that. Then i think about science, the possibility of having these extraordinary breakthrough innovation engines to advance science. You mentioned proteins. I think its quite stunning thing that, you know, my colleagues at deepmind, alphafold, was able to predict the protein structure of all 200 million proteins known to science and then make that available to everybody. Its astonishing. Its astounding. But then i think also about some of our pressing challenges today. Think about access to Maternal Health in low Income Countries and communities. Think about Climate Change. You spend a lot of time thinking about the effects of Climate Change. Think about all the things we see in california wildfires. You know, the mayor can talk a lot about what we see in california. So all of these things gives us the possibility of actually addressing and enhancing how we tackle all of this. This is what motivates me and excites me. Definitely my lifes work and what i always wanted to work on since i was a little kid. I studied it in school. It wasnt working at the time. I got kind of sidetracked for a while, but as soon as it looked like we had an attack vector, it was very clear that this was what i wanted to work on. I think this will be the most transformative and beneficial technology. Humanity has yet invented. I i think more generally the 2020s will be the decade where humanity as a whole begins the transition from scarcity to abundance. We will have abundant intelligence that far surpassed our expectations. Same thing for energy, same thing for health. Few other categories too. But the sort of technological change happening now that is going to so change the constraints of the way we live and the sort of economy and social structures and whats possible. I think this is like going to be the greatest leap forward that weve had yet far yet so far. And the greatest leap forward of any of the of the big technological revolutions weve had so far. So im super excited and i cant imagine anything more exciting to work on. And on a personal note, like four times now in the history of openai, the most recent time was just in the last couple of weeks ive gotten to be in the room when we sort of like push the front, the sort of the veil of ignorance back and the frontier of discovery forward and getting to do that is like the professional honor of a lifetime. So thats just its so fun to get to work on that. And its remarkable, though, that for each of you, youve been working on this for decades. And so but now we find ourselves in a particular moment of inflection. So i wonder if you can help ground the audience in in understanding the ai lab landscape. So how does how does each of you think of where we are with the technology in the Development Overall development of generative ai . James feel free. Yeah, im happy to start. I mean, i think its worth reminding ourselves that ai has actually been with us for a while. Actually, a lot of the progress started to happen in the early 2000 with things like image recognition, natural language processing and in fact, many people today, you know, even before sams extraordinary moment last year, were already using ai. So, for example, theres over a billion people who use Google Translate. Thats a i. If youre using search, thats ai. But i think there was a particular moment that that that is brought us here in 2017 when my colleagues at Google Research published a paper called attentions all you need it introduced called attentions all you need. Thats the paper that introduced these transformer based architectures that are the underpinnings of these Large Language Models. That paper was in 2017. A lot of things and rapidly accelerated from that moment. We all started to train these Large Language Models and they all started to do these very general things, not just narrow things, because remember before this we had what you might call narrow ai. You could do ai for speech synthesis , for image classification and all of these things. But these large language model systems suddenly be able to do very general things and things just accelerated. So i think that was a Pivotal Moment that has brought us to where we are and so where are we . Well, i think were at a place where we can talk about this, where these systems are now very broad. Theyre very general. Everything from writing poetry, composing music and all these things. Theyve also become whats now termed multimodal. So its not just language and text, but also images and video and all these things and coding. Its a very exciting time. Were starting to see them do very well on benchmark tests on how well do they do on kind of a range of cognitive tasks and capabilities. Theres something called big bench, which has Something Like 204 kind of metrics. You can evaluate. So theyre starting to be very, very, very good. But i think its worth pointing out that they still have some serious limitations, actually. So as amazing as all these general capabilities are, theres still mistakes, theres still mistakes. Factuality fauci and so forth. But these are things i think will get better. But those limitations are quite real. Thats why i think its very important to have a deeper understanding going for where we are now about what these systems are good at, what theyre not good at, how we solve and augment those capabilities, link them to other systems. But im actually pretty excited because the what i now call the scaling laws and im sure sam will also get into this, is as you scale these systems, they seem to get more capable, more powerful, and the possibilities are very, very exciting. I agree. Theyre very exciting. They they also can be very concerning. And for some people really frightening. So i want to read to you, sam, a quote from the wise public intellectual, yuval harari, who said, ai is the first tool in history that can create new ideas by itself. Theres a danger that we will spend all our effort on developing an ai at the time. We dont understand ourselves, which is right now, and then letting ai take over. And that would lead to human catastrophe. So we obviously dont want that. So that brings up this question of proper regulation and proper guardrails and i think having the industry be come together as it has and take some steps forward around how do we how do we think about this collectively. So the industry has taken a very healthy step forward by launching the frontier model forum. And just in the last two weeks weve had a lot of regulatory bodies come forward. We had the white house executive order, we had the bletchley declaration, we have the advisory body on ai that the un has convened. So id like each of you to talk a little bit about how you think about some of the existential threats like yuval has articulated and others as well as the state of regulation on whats whats proper, whats too much . How do we get it right now and then be open to evolving as the technology evolves. I had dinner with yuval in tel aviv and early june of this year. He was very concerned and i understand. And it i really do understand why if you have not been closely tracking the field, it feels like things just went vertical and we didnt you know, sure, people maybe were doing stuff before, but not not like people had these papers here. This model here, this narrow thing here. But people that use like Machine Translation dont really feel like theyre using ai and all of a sudden there was the sort of perception of like something has qualitatively changed. Now i can talk to this thing. Its like the star trek computer. I was always promised and i didnt expect it to like happen. Why this year . Why not a year ago . Why not in ten years . Like what . What happened . So i think a lot of the world has collectively gone through a lurch this year to catch up. Now like humans can do with many other things. People are like, yeah, man, wheres gpt five . What have you done for me lately . Weve already moved on and thats great. I think thats awesome. Thats a great human spirit. I hope we never lose. But the first time you hear about this or use it, it feels much more creature like than tool. Like yes. And then you get to use it more and you see how it helps you and you see what the limitations are. And its just like, okay, we have like another thing on the Technology Tree that has been unlocked. Now i do think this time its different in important ways. And this is maybe the first tool that can self improve in the way that we understand it. But we need new ideas is like i think were on a path to self destruction as a species, right now. We need new ideas. We need new technology. If we want to flourish for tens and hundreds and millions of hundreds of thousands of millions of years, more and i think a lot of people see the potential of that in ai. But its not like a clean story of victory. It comes with, all right, we do have to mitigate these downsides. So we want this. Its great in the short term, it does all these wonderful things to help us. And we can see in the medium term how it can help us cure diseases and find new ways to do all these, solve some of our most pressing problems. But on the other hand, how do we make sure it is a tool that has proper safeguards as it gets really powerful today . Not that powerful, not that big of a deal, but people are smart and they see where its going. And even though we cant quite intuit exponential as well as a species, much we can tell when somethings going to keep going. And this is going to keep going and so you have this question of how do we get as much of the benefits as possible, not it unduly slow those down. And everything you said, you know, i tutor for everyone on earth. Yes please. Sounds amazing. Medical adviser. Yes. Cure every disease. Great but but in the hands of bad actors. How are we going to what kind of limits are we going to put in place . Whos going to decide what those are . How are we going to enforce them . Like, what are the rules of the road going to be internationally where we have to have some agreement and people realize the challenge of that . That said, this has been like a significant chunk of my time over the last year. I really think the world is going to rise to the occasion and everybody wants to do the right thing. And what about the executive order . How close does that get to getting it right . Lots of things there that are like worthy of quibbling and lots of areas to improve it. But as a start and saying were going to do something here, i think its a good a good start. The real the real concern of the industry right now to paraphrase, is how do we make sure we get thoughtful guardrails on the real frontier models without at us all turning it into regulatory capture and stopping open source models and Smaller Companies create, i think, open source is awesome. Im not not everybody agrees with that. Im thrilled you all are doing it. I hope we see more of it. I think i think we should have a conversation about that. Sure but keep going because you have some elements. But but its just its a hard message to explain to people that like, current models are fine. We dont need heavy regulation here, probably not even for the next couple of generations. But at some point when the model can do like the equivalent output of a whole company and then a whole country and then the whole world, like maybe we do want some collective global supervision of that and some collective decision making, but to land that message and not say its like, hey, were not telling you, you have to totally ignore present harms. Were not saying you have to like you should go after like Small Companies and open source models. We are saying, you know, trust us, this is going to get really powerful and really scary and youve got to regulate it later. Very difficult needle to thread through all of that. Yeah. If i could before, we should obviously discuss the open source question, but i wanted to take a step back just on the regulatory question, first of all, which is i think its worth thinking through. First of all, what are the kinds of concerns that seem to come up that then drive the need for thinking through regulation . I think its worth teasing that out a bit. So, for example, what you typically have as concerns are in a few categories is one, are concerns about about the kind of outputs you get from these systems. There could be bias, there can be toxic, there can be nonfactual and all of those things and those kinds of outputs can cause harms in themselves that we dont want that may be harmful to society. So theres the theres this need to think through that. Question. Yes, youve got a second. Both the data and the algorithm, the outputs of them and so forth. So theres that question. Theres a second question which has to do with how do we think about use and misuse, even if the systems work very well, how do we want to think about what uses are appropriate, what uses are not appropriate . It you know, are we misinformation, disinformation, thats all about kind of use and misuse. We should think through that and what the rules should be for that. Then youve got all these other concerns about when this Technology Works its way through society. Implications for labor markets, for things like intellectual property or copyright and so forth. Then of course, youve got the kinds of safety questions that sam was talking about as we get more capable systems, how do we want to think about the approach to safety and those . So i think its worth because what happens in these regulatory conversations, often people are coming from any one of these different consideration options. Yes, i imagine theres a lumping in that happens exactly. And so when you look at, for example, i think many of the conversations that have come up so far, whether its the uk summit, which is billed as a safety summit, was mostly concerned with that latter question about safety in these systems. If you look at some of the what were the white house commitments that came out of many of our companies, theyre mostly again oriented around these safety questions. So i think its worth thinking through the whole set. So the Advisory Council or the Advisory Board of the un that your cochairing are you breaking down these these four different categories and trying to articulate appropriate regulations around each of these . Well, were thinking through first of all, this is the un high level advisory body. So weve kind of organized ourselves to think about three kinds of areas. One is to think about the opportunities and enablers of the opportunities. Keep in mind, as we all said, theres so much thats exciting that could benefit the world. So were thinking about those opportunities and enablers. Then were also second thinking about the these complexities and risks of all these different kinds that i just described. Then the third area were thinking a lot about the governance questions. Whats the right way to think about Co Ordination and governance . And so forth in ways that benefit the whole world . Because one of the risks that we have is we likely could end up with a patchwork of regular relations and frameworks that are just so confusing. So i just thought it was useful to think about the broad landscape. But we should come back to the open source question because that is one of the we will just we will just to pile on with james like part of whats happening now that is useful. Well, i mean, the first thing thats happening is a lot of people are paying attention to ai, which is a good thing. Yes i think if you look at earlier chapters of the internet, it was not the case that everybody was paying attention. I think when the internet began. I think a lot of people thought it was a fad. And i think, you know, the Silver Lining of all of the attention on ai is theres a lot of attention on ai, and that means that you have the scrutiny of not just folks outside of the company, but folks inside of the company. I think one of the things a lot of people dont understand about our companies is like, you have a whole lot of very serious people whove spent their whole life thinking about ai safety and what does bias mean, what is an unbiased data set look like . What is toxicity mean . How would we measure it . How would we measure it in hindi . How would we measure it in bengali . How would we measure it in a language we dont have a huge corpus of on the internet . These are each of these questions. It turns out, is hard but important. And i think one thing that i think a lot of outsiders to new tech dont see that im inspired by is the amount of people inside of the companies who are incredibly serious and dedicated to each of the sort of nuanced chapters inside of the whole story of ai safety. Yeah. Thank you. Thats such a good point. Yeah. The other thing that i think james is helping to do that we need as an industry is not sort of like 32 different versions. Us of regulations like we all are like totally down for regulation. And i agree with everything sam said that my general perspective and my companys perspective and my teams perspective is the current models are pretty, pretty good. If you look at the vast majority of good use cases and like we have not really been been able to find lots of ways that it can be misused, but that may not be true. 2 or 3 generations out. And i think thats something that the industry generally shares as a perspective right now that is very frequently lost in translation, as i think lots of folks start to peer in and try and pull apart the ai questions. And so returning to the open source question, how do you at meta balance use the benefits of open science and open research and open data sets or algorithms with the fact that bad actors could actually cause a lot of trouble and harm a lot of people and who decides whats open and whats not open and how . How is that decision made . Yeah, sure. So just as history meta built, designed and deployed lama, which was the first large language model that we open sourced back in february, as well as lama to which was the most recent open source large language model. We open sourced in june. Our company was built on open Source Technologies and i think its worth remembering when we look back on the early days of the internet as was apple, as was as google. A lot of the tools that we use to build companies in the early days was open source technology. It was linux, it was apache, it was mysql, it was php, it was technologies that allowed entrepreneurs to not have to go pay huge licensing fees in order to get access to tools that allowed them to build companies. That became Amazing Things. So we all owe a lot to open source and the individuals who, whether for technologies or whether for Services Like wikipedia, sort of volunteered to contribute to Technology Changes for the benefit of technology artists and for the benefit of ultimately science and medicine and education and all these other things. So information exactly. And so i think, again, as folks are starting, some folks are looking in on this for the first time, like what does open source mean . And i think its important to remember we are here because of open source technology. Is now how did we make the decision to open source lama and lama to first of all, there was an enormous amount of inbound from scientists, from chemists, from folks who were at serious institutions working on the hardest problems, from folks researching cancer, from folks working in e commerce, working on fraud prevention. I mean, name a problem. We were seeing that there was an enormous appetite to have access to a model that was close to the frontier, that was safe, that had like gone through all of the hoops of fine tuning and adjusting system cards and red teaming, which is where you get various category of sophisticated people to pretend they are bad actors in order to test the veracity of the system. We also spent a long time talking to other folks, other sort of luminaries in our industry. We spent a bunch of time with government, with the white house, with elected officials in other countries to sort of just like bounce off them. The idea that we were contemplating this, i think for these sorts of technologies, those steps are necessary. The other step thats necessary is publishing all of the work that you did. And so not just publishing the model, but publishing how you what led you to conclude that the model was safe for us . That was a 65 page paper written by the Ai Safety Research hours walking through every single step that we took. I think without that level of seriousness, to show me your work, the model, you cant just say, trust us. And some of this is in the executive order as well. Yes. And thats where i think the executive order is pushing at the right topics. Its like for should everything be open source . No so should some things be open sourced . Almost certainly. Where do you draw the line . Hard question. But in the meantime, lets talk about the steps that were taking to answer it and then have the debate out in open. Yeah. Yeah. And i look back on the decision in june. I feel very good about it based on the immense amount of i mean, every week i hear an incredible story of lama2 being used to, you know, it was this week, it was like stanford students writing a creating some glasses that allowed a blind person to understand what was being said in front of them. And that was just some stanford students using an open source model. It wasnt a massively multi billion dollar company. It was a group of students. Yeah, no, these tools, when put in the hands in a democratic way, will create marvelous things. Yeah, its true. Sam how do you respond to chriss point of view, of course, youre very familiar with it. Strong strongly. I dont think i have anything interesting to say. I strongly agree with all of that. I wish i could find something to pick apart for a better panel, but what about you . Well, i think i would agree also, but also emphasize a few other things. I think one of the things that open Source Matters for while in addition to encouraging innovation, entrepreneurship, ship, you know, people to innovate, the stanford students chris talked about to do that. I think it also gives researchers and others a chance to understand what were doing. Yeah which i think is also quite important. So all those benefits i think are extraordinary. I think we have to take that quite seriously. I think the and i think we want to all of those. I mean, googles grown up, as chris said, as an open source company. I mean, android is open source. We actually have some models that are open source. I think the question for us Going Forward is, as chris and i think sam implied, but you can jump in, is as these models become more capable 2 or 3 generations from now, how do you want to think through that question . Not with the concern about innovators and entrepreneurs and researchers, but with the possible of bad actors. So thats the question were all going to have to grapple with. I think in a perfect world, id like to do all of it. Id like us to get all the benefits of open source, which are big advocates for. But we are going to have to think through these other questions Going Forward. And i think what i find a lot of a lot of comfort in is the fact that that you all are actually having these conversations and you know each other. And theres open discourse. Theres some disagreement. But but its healthy. Its healthy to have these conversations. Whats not healthy is not talking about it. And going off and doing our own. And then endangering the rest of us. But and in the next several generations of products, im sure that the conversations will continue to be interrogated in 2024, which is this coming year. However, we have right in front of us not only the us election, but elections in 40 other countries around the world. And weve already seen disinformation in over the last eight years and ai has the potential to supercharge disinformation. And so how do you how are you all thinking about that . How are you all thinking about ensuring that if ai is used in political advertising, its disclosed like meta is positive thing, but also how do we make sure that we can understand if there are deepfake videos, if there are deepfake audios, if theres personalized. Convincing adverts rising, how do we navigate through this in this coming year . Yeah, i think one one thing that weve learned over the past ten years, i would say, of focusing quite seriously on our role in elections is, is first of all, ai is the sword as well as the shield. And what that means for us is so much of your ability to scale. How do i find every lets say i find a photo that was misleading . How do i find every other instance of a photo that looks like it quickly . Thats the kind of problem you want to be able to solve, to operate at scale, because that allows you to take for us, for example, if we have something thats reported, start to going viral, factcheckers can look at it. They can decide if its misleading. They can label it. And then i can help us quickly detect everything that looks like it and those sorts of systems, whether or not an image was generated by ai, whether it was generated with photoshop or whether it was an actual image or whether it was a piece of text agnostic to how the piece of content was created. A lot of the systems that we built over the years can be used and be deployed against this sort of behavior, but also i remember and this may be a sore spot, but i remember there was a deepfake with nancy pelosi and facebook didnt take it down. So im not blaming you, but but that happened. And i know that that was a source of a lot of tension. So how do we as Consumers Trust what were seeing and how do public personas trust that their likenesses are not going to be manipulated . Yeah. So i think the first thing is, sam and i were just talking about this. There is a fair amount of Public Awareness on people should be skeptical about deepfakes, like whats interesting about this chapter of where we are with the internet, is there already is a broadly held understanding that like deepfakes are something you should keep an eye out for. I think thats good. Um hum. The second thing is, you know, weve gotten a lot more sophisticated at understanding and detecting, detecting this information. The way we do that is working with 90 different Fact Checkers certified Fact Checking institutions across 60 languages in order to understand that for content that goes viral, lets have somebody lets have sort of professionals take a look at it and then make sure we label that content. So those are the kinds of things that weve learned over the years to make a huge difference in protecting people during elections. And for us, all those tools keep Getting Better every year, and well make sure that sort of whatever ai throws at us, like well use that for the benefit of our users. What do you think, james yeah, i would actually underscore something chris said. Maybe add something to it. One is its worth remembering that in fact these tools and technologies can actually be part of the solution when you have platforms, im sure its true for you, for you, chris but in our case, like youtube and other platforms at the volume that content is being uploaded, it far outstrips any humans ability to review every single thing. So in many cases ai is actually assisting in that task to be able to do it at scale. We also find that even in our ai systems, when were doing adversarial testing, ai tools are actually part of helping with this. They should be. Exactly. So thats, thats kind of one part. The thing i was going to add is one of the Important Research tasks we all have. And were starting to make progress on it, is how do we develop new techniques to improve our confidence in information . So in our case at google, weve been spending a lot of time investing in research on watermarking and kind of provenance technology. You know, earlier this year we actually, for example, introduced something called synth id, which is a watermarking technique were building into all our generative systems. Its still early days, but even that already is going to make a difference. So theres a lot of Research Still to be done on how do we safeguard these systems, how do we try to explain, make clear the provenance of the content and where it came from and how it was created and all of that. Thats still work to be done. But this is an area where theres still so much more work to do. And, you know, i think were just getting started. Sam yeah, lets talk about next years elections and what you anticipate. I really think the thing chris and i were talking about, i really do think we underrate how much of like societal antibodies have already been built, but its imperfect. And also that the dangerous thing there is not what we already understand, which is the sort of existing images and videos, but its all the new stuff, the known unknowns, the unknown unknowns that are going to come from this so we can talk. We talked recently a little bit about this idea of personalized one on one persuasion and how we dont quite know how thats going to go, but we know its coming. Theres a whole bunch of other things that we dont know because we havent all seen what, you know, generative video or whatever can do and thats going to come fast and furious during an election year. And the only way were going to manage through that is a very tight feedback loop. We collectively, the industry, society, everything. I suppose the problem is that often the damage is done and then then we notice and then we correct and, and i also understand about broad antibodies at the societal level because weve now been swimming in a sea of propaganda and misinformation. However where we still have a lot of people ill in this country and elsewhere who believe in conspiracy theories that are easily debunked. But nevertheless, yes, they believe in them. And that has to do with human nature and the way that the brain latches on to information and thats something that that we cant quickly evolve past. Yeah, thats weve struggled with that for a long time in human history. You know, conspiracy theories are always that thing somebody else believes. But i dont want to i dont want to like discuss that problem at all. Like that is something deep about human psychology. But its not new with this technology. It may be amplified more than before. Amplified. I agree. Its not new relative to what weve already gone through with the internet. Its not clear that ai generated images are going to amplify it much more. The way you its all of the other. Its the new things that i can do that i hope we spend a lot of effort worrying about. Um, and, and a lot of the three of you and others speak often with elected officials and political leaders, and these are all us based companies. And so how are you thinking about obviously wanting to be inclusive of and have equitable distribution to benefits across the world, but also balancing that with Us National Security . And im sure that comes up in a lot of private conversations. But what can you share with this audience about that . Well, i was going to pick up that question. Lorraine, was something that sam just said. I think one of the things that is worth keeping in mind, especially in a setting like this at the asiapacific kind of summit, is that a lot of these questions are really about us, not about the technology, energy about us as societies, because a lot of these questions about whether its bias or in all these questions often are very different from place to place. Country to country. We found, for example, as weve rolled out these technologies, having to have very, very different conversations in Different Countries about what counts as bias, whats not in different communities. But these are questions about society and not so much about technology. I think we, you know, society kind absolve itself of this question, of these questions and sam said societies faced these things for centuries, but maybe this Technology Amplifies this. I think we all have to think about these normative different questions in all our Different Countries. I think thats important to keep, to keep in mind. But at least hopefully theres a baseline we all agree with, which is hopefully we all adhere to things like basic human rights, human freedoms. Those kinds of things safety, violence and so forth. I think we can agree on. But thats just the floor, not the ceiling. The rest, i think, is up to us collectively. I think in conversation. Asians, to your question with various governments, i think there is clearly a serious concern around safety, around misinformation. And i think we all have the responsibility to do more Technical Work on that front to safeguard these systems and do as much as we can. One of the things many of us have encourage urged governments to do is to help us set up mechanist isms so we can actually all share and learn from each other because were all experiencing, im sure, sam and his team and our teams and chris and were all learning Different Things from how our technologies are being used. So there are some mechanisms to be able to share that. I think thats part of the hope that comes out of some of the uk summit, some of the announcements at least in the us, about the ai institute and the kind of the framework birx that nest and others are going to put in place for how we can share kind of best practices. I think were going to need that base infrastructure to quite frankly and have it be somewhat harmonized around Different Countries around the world. So im very hopeful about what the kinds of conversations that have been happening recently. Yeah and to your question on working outside of the us, its funny. I would say the biggest difference between operating in the us and operating in a country like brazil or india or indonesia is whatsapp and i think a lot of Americans Still dont understand the primacy of whatsapp as an experience that matters a lot for folks in huge swaths of the world. Its the Worlds Largest messaging platform. We spend a lot of time with governments and also with ngos in each country where were big during important events. So during covid we spent a bunch of time in brazil and india and indonesia and mexico trying to understand how folks were getting information and what information they were getting, figuring out how we could play a role in helping them get up to date Accurate Information from the Public Health ministry. Turns out the answer on whatsapp was like, just put all over the country like text this number on whatsapp and well send you up to date information on social distancing, on vaccines, on masks, on whatever. We do similar things during elections to give folks in region one basically access to some institution they trust in the tool that theyre using to get a lot of their information. So we do that. Weve learned that its important not just for the people in those countries, but also for like the ongoing relationship of trust with for us to be brokers of those Services Like we do really need to do a good job of showing up during a Public Health emergency, during during a National Natural disaster, during an election in during a war or a crisis. We put a lot of time and energy into how are we helping people get Accurate Information. And i think thats something i know google does quite seriously as well. And its something i think we as American Companies operating Global Services have tried to really improve upon every year. Yeah, i have to say one more thing, though, on this point, which im sure weve all had the experience, which is its always exciting when you go to other countries, especially developing countries, especially in the global south, where you go to latin america or to africa or asia, where the conversation options are somewhat different. Actually, often theres a lot of excitement about the possibility to transform, leapfrog and get access to the worlds knowledge and information, but also some different other challenges about how do we make sure that they are including and participate and have the tools and the capabilities to capture relies on these technologies and the possibilities for their own economies. We get for example, were spending an enormous amount of time on things like these language moonshots. So for example, Google Translate works with roughly 133 languages, but were trying to get to a thousand because is that opens up inclusivity in ways that are extraordinary to people in many, many different languages. Us in latin america and africa and other places that i think i think so i think part of the exciting opportunity is to how do we enable economies entrepre occurs everywhere, quite frankly, to take advantage of this and pursue their own ambitions and do Amazing Things for their countries and for their communities. Thats pretty exciting. Yeah. Well u2s up for the perfect last question. James so lets assume that the four of us are sitting on the stage here again in 2024 because the mayor did such a brilliant job at hosting everyone at apec. There are all coming back. So well come back to and well have this conversation and i will ask each of you, what is the most remarkable surprise rise that happened in ai, in your field, in your company in 2024 . And what is it that youll be telling us about sam . Do you have a thought . The model capability will have taken such a leap forward that no one expected . Wait, say it again. The model capability, like what . These systems can do, will have taken such a leap forward. No one expected that much progress. And why is that a remarkable thing . Why is it brilliant . Well, its just different to expectation. I think people have like in their mind, how much better the models will be next year. And itll be remarkable how much difference it is. Okay thats intriguing. Plus one to that. But id also add that when is gemini going to ship . Well, thats the thing were about to enter an exciting were all waiting to know when you would like to know. Lets give us a little information. Im very curious trying to get them. Thats going to be so exciting. I think itll be a story about gemini. Well be telling you about gemini and the kind of capabilities that these systems are unable to do. But more importantly, i think well be talking, i hope lorien about 3 or 4 big societal breakthroughs will have done with this technology. Ideally in science, ideally on something that really , really matters for society. I hope we can show you 3 or 4 such things. I mean, proteins and biology are one thing, but i hopefully therell be more in education, in more in health care. I hope to come back with at least a few of those. Yeah, i really agree with what jane said. I think what well be talking about is something none of us anticipate that is positive, that comes from somebody who previously would not have been able to build somebody or some institution that would not have been able to accomplish something until one of these models and the associated tech that came with it. I think thats part of why were all so excited about this. Yes. Yes yes. I think in health care alone and in disease. Quest alone, there will be some amazing breakthroughs. Amazing. Yeah could i add one more . Yes, i also think well have gotten to a place, lorraine, to your earlier question, where weve were figuring out and struck the right balance between making sure we have mechanisms to limit and address the harms and things were concerned about. But at the same time have some extraordinary kind of proinnovation things that enable the opportunities that we all want. I think we somehow get stuck in this debate. Its one or the other. We have to do both. We have to do both. Well im im just pinning my hopes on the three of you to get that one right. So thank you. Thanks to the panel. Thank you. Thank you. Thank you. A century ago, building a dam in the high country of the sierra to bring a supply of fresh water to the San Francisco bay area was a monumental undertaking. Mayor sunny jim rafh turned to michael to mastermind the project. Michael was a force of nature. Air fwant in some ways but also a mans man. He supper advised the construction and it was the greatest engineering seats in the united states. The remow location of dam and reservoir made getting to the site a challenge. They had to get access to the slopes of the Sierra Nevada so they her to build a railroad to get Construction Equipment and materials into the site. They had to generate power so they built another reservoir to generate power and they did a remarkable amount of work with much less sophisticated equipment than what we have today. Concrete for the dam was processed at a plant just upstream from the construction site, using sand and rock from the valley. Nearly 400,000 yards of cubic concrete were poured around the clock. Oshansee was a detailed oriented guy. He was having his man dig down the bedrock and they would dig and dig and pull, you know, out debris and they come and say, okay, weve gotten down. Were down far enough. We need to personally look at it and say, no, dig deeper. In may 1923, the dam was completed and named first chief engineer and behind it, an 8mile chef of the Hetch Hetchy Valley was flooded and holding back 115 billion gallons in the new reservoir. It would take another 11 years to finish the system and bring that water across california to the San Francisco bay area. This was the moment. It was made pos driver, bye. Hi. Im will b. Mixture weltake a walk with me. I just love taking strolls in San Francisco. They are so many cool and exciting things to see. Like what is that there . What is that for . Hi. Buddy. How are you. What is that for. Im firefighter with the San Francisco Fire Department havings a great day, thank you for asking. This is a dry sand pipe. Dry sand pipes are multilevel building in San Francisco and the world. They are a piping system to facilitate the fire engineaire ability to pump water in a buildings that is on fire. A fire truck shows up and does what . The fire engine will pull up to the upon front of the building do, spotting the building. You get an engine in the area that is safe. Firefighters then take the hose lyoning line it a hydrant and that give us an endsless supply of water. Wow, cool. I dont see water, where does it come from and where does it go . The firefighters take a hose from the fire engine to the dry sand pipe and plug it in this inlet. They are able to adjust the pressure of water going in the inlet. To facilitate the pressure needed for any one of the floors on this building. Firefighters take the hose bunked and he will take that homes upon bundle to the floor the fire is on. Plug it into similar to this an outlet and they have water to put the fire out. It is a cool system that we see in a lot of buildings. I personal low use federal on multiple fires in San Francisco to safely put a fire out. I thought that was a great question that is cool of you to ask. Have a great day and nice meeting you. Thank you for letting us know what that is for. Thanks, everybody for watching bye [music] bob morts, global german and chief executive officer of pwc. Good morning everyone. Thank you to be the early birds. Sitting here, fighting all the possibilities so that we guarantee a great conversation and my name is kim way, the moderator for this panel. The gobel economy and state of the world. I am a moderator coming from [indiscernible] so, this is a big one. The Global Economy and the state of the world. We could spend 10 days here, but im so glad im joined by a very Capable International Business Leader, bob moriz, global chairman of pwc. I know bob for a long time, but i think every conversation we had over the years, there is always fresh input given the circumstances. So, bob, i dont want to do too much introduction. Everybody has a perspective what the world is like and state of the economy but i want to jump to you about the Global Supply chain. I know that is on the mind of every business person in this world. What do you think might be some of the latest science that could help us to analyze better about the real state of the Global Economy . Thank you. Pleasure to be with everybody today. As pwc, we have been a partner 14 years. The reason is the importance of the countrys in the Global Economy that represented in this room and to your point, lets go back a year. The countsry here, the economy was thought of positive globally and very positive locally. The Ceo Community had confidence what is going on and here we are a year later and you have a concern about the slowing of the Global Economy, but yet the representatives and ceo here in these countries are still very positive about the economy and opportunities in their region. That is important. Having said that, they cant have a sense of complacency and lets talk about supply chain in that regard. What happened over the last few years is organizations have worried about the concentration risk in supply chains, the resiliency of supply chains and aspects like that. Many governments are try toog insure more onshoring as well from a policy perspective about the Ceo Community continued to focus on four major themes. Are the economics right . Do i have the resiliency and agility of that supply chain from . Can i actually greener and cleaner . And likewise, can i get the data to make faster better decisions . Thats really important because historically the supply chains and decisions where to go focus oen a couple key ing thes. It was the skills in the country. Is there availability of resources in the country . What does infrastructure look like and they look at the risk factors. Is there certainty, regularty risk and ease of doing business . The two new things right now are the green element of that supply chain and the data. Thats where Digitalization Technology and ai will be really important for management teams to think about how can we create opportunities for people to use our supply chains either corporate or the countries that are providing them and that is the upset Going Forward. Im glad you mapped out important factors. We like to dig into a bit later. About resilience, we have seen political environment changes over the years. Now some miner signs things might be getting a bit smoother, for example with [indiscernible] taking place on the siteline of the events we are seeing here today. What do you think the Business Leaders would like to say to the political leaders that are coming here during the apec week . What is likely to be the Common Ground between the Business Community and the political leaders . So, let me take this from three angles. First, as it relates to particularly the big elephant in the room, the china u. S. Relationship. We are looking for a deescalation and more bringing the temperature down in terms of a little more normalcy. Can cant be total normal but more normally then the tejz world filled year we had. Second is the signs that there is a willingness and wanting to actually continue the trade and lets be fair here for a second. The amount of trade between the two countries and the importance of the two countries of the world, very very important. Yes, indeed. Last but not least is make sure the tech [indiscernible] those that should be talking to one another regularly about policy changes and trade agreements and other aspects are able to talk more freely to enable the infrastructure and trade and direct investment to move forward and thats the importance of today. The second point though is, lets not limit this to just the u. S. And china. The reason this particular group of people gather is that, which is how to get more policies and procedures in place more certainty in place to move forward . You heard from the secretary a moment ago talking about her responsibilities. Well hear from the prime minter of mulasia. They want less risk and more certainty. Last but not least the third element, how you indicate the sign of the direction of travel, because when you make decisions on supply chain you think about the conditions that exist today, but the conditions that exist over the next, 3, 5 years so look frg the stability. Not obviously interesced in todays policy and procedures but the plans Going Forward and that is the dialogue we hope to hear today from policy makers and politicians. You hit a important power word, dialogue. Used to be the case we say that all the time. Every minute all most and it is not the luxury and now it becomes quite a luxury. That is also what i want to ask with you, bob. What does it take to have real dialogue . I want to hit this from two perspectives. To have meaningful engaging dialogue requires a element of openness and discussion around the challenges and opportunities from both sides. Or multiple sides, depending who is in the room. Second, is understand the rational and reason why, not just the what, but the why behind it. People can understand where each other of the parties are coming from. That is important to start the discussion. The realty is, you want to enable trust and trust means you have to deliver on what you committed to deliver previously, and that is equally as important. It is one thing to have dialogue and discussion, but another to execute and deliver against that dialogue to enable future trust so the foundation is stronger moving forward. As we sit here today, the one thing i would say is discussion isnt good enough t. Is execution of getting things that is equal important to enable the trust to continue to sustain itself. People say, are you guys having on the stage communication one on one . Actually, sometimes this become a luxury these days. Having said that, how are we going to set all these conversations with the backdrop of Asian Pacific . There are so many different ideas related to this region so how do we look at the state of the ecaenomy of the region as to what group should we have . What would be the nature of the different groupings . What are likely to be the chemistry among all of them . If there is any. Bob, as a Business Leader. As a Business Leader i say for pwc and all our clients, we see a lot of upside in the region. You see that upside driven by three primary rationals. One is the domestic economy are continuing to grow. [indiscernible] think about the rise of the consumer and the consumer what they need in terms of goods and services. The second thing is that, those particular countries and the companies within them are now more alternative sources for supply chain and creation of goods and services and important to the world wide economy and thats equally important. Last but not least, it is not only the issue of the economy, but the contributions that come from this part of the world as well to future endeavors. Technology digitalization ai is a good example of that, where the skillset s today are fantastic in the region to be leveraged and turned into a big opportunity, so it is not all the economics, it is also the policy setting, the standard setting and other aspects that are really important and we hope that the countries in this room in this cooperative are more so at the table, at the global table to make sure their points of view are brought and advances invasion happening here are brought to the rest of the world. We see the governance of Technology Including digital technology, such as ai lack behind the Real Development of technology, so much so we have seen this transfer all most past the four decades. Since the very beginning of the computer and stuff like that. Anyway, are we seeing with the recent discussion both at the un and earlier taking place in the uk bringing all the players together around the table, real consensus about the discussion . On ai. You do not have consensus on ai. This is a very early stage right now in terms what is happening. Aa has been in existence a long time. We are talking about degenerative ai and what is happening of autonomous ai where thinks are done in such a way where it is replacing humanity and within that it has the ability to bring the language it is so interictive that had has ease of use. You have three things fundamental of the standard setting of ai. How comfortable and trusting of the of what has been done. What is responsible coding to make sure we flush out that and have a buyer be ware concept if i use it i understand what the coding leads toward of the outcome. The second piece is data. The ai only works if it has access stoodata. The question is what access is providing to ai to give the outcome and that is equal important understanding that. If i limit the ai to have the data in a particular country, that may give me the basis for country. Last but not least is make sure the ai that is created is governed appropriately supervised appropriately and in fact delivering what is intended. Those three things are being discussed in various forms. What do not have is the ult to converge what responsibility ai looks like. There are a number frameworks put out, but what the world needs to do and why the region can be so influential is be at the table to converge lective thinking in country, across sector and government and business working more so togethers. We have seen asian Pacific Region dynamic bringing consenss for the trade mechanisms given the backdrop of a ever evolving world has been functioning well in the region. Would that be a wonderful precedent of people coming to consensus on all the Technology Related governments as well, particularly regarding generative ai as you said . Absolutely. Where are we now the state of the world . We are at the early stage, but i think there is a opportunity for discussions today and what comes out of the meetings to continue to be a roll model for the world and the world to jump in but to have in a open way, because there is different points of view. Back to your point around discussion, it is discussion, agreement and ult mltly framing up in the right way to apply at the local level. I do think there is a big opportunity. Organizations are seeing it today in invasion happening in this part of the world and think they will want this Going Forward because aioneed you need the trust in the ai as that is important to them to deal with effectiveness and efficiency as we go through economy and margin improvement. At the same time ai is dealing with that and discorrupting strategy and business propositions of corporate and that matter countries as well. The wonderful thing is, how latest Ai Technology and governance work with sustainability which is one of the core issues we have seen focused on during this years apec ceo summit. What do you see likely to be the synergy here . There is first question which is definition of sustainability. Right. If we think about climate there is a huge opportunity for how ai can help with that. Let polk get granular for a second. If i think about the efficient of a building, there is not enough humans and not enough Computing Power right now to actually indicate how that can be most effective and efficient of energy use and ai is powerful enough today and efficient enough today to do better then human decisions can be. There is a tremendous opportunity as a result to think how we can drive for more naeshancy using ai as we think about energy use of buildings like this, for example. Having said that, you got another element of sustainability and that is implications to humanity and labor. As ai comes forward, there is many different dooms day discussions around how many jobs will be taken away and yes, if we dont actually think about how we enable the ai to be more effective and efficient while at the same time redeploy the talent in new and different areas we will have a mismatch which create more social unrest which is something we cannot afford to have. When we talk about here is a timing gap. Humanity has proven any time there a large scale transformation impactful on labor we have historically been good, some time thereafter figure what to do with excess labor capacity and put in new different ways. There is a need to deal with that ination invasion as much as ai of supply and talent. When we think sustainability we should think climate because we are not doing enough and far behind as evidenced in the discussions coming up, but lets not forget implications to labor, workforce and humanity overall as wem. Here is similar logic with the question of ai and governance of ai. We see geo politic changes so much over the past few years and that people wonder whether we should wait for decisions coming from the big powers and thenor we should have parallel passages with different players playing their role and bring consensus. This means a lot of different chemistries. You need time to sort it out, but still which to you as a Business Leader would likely to work the best . The realty is, we are not in a world where we can afford to wait for the powers to be to make a decision and rely on government alone or anybody else to make that decision. Invasion at the local levels cascadeed off and scale off is the way to make progress and what we see today is Business Community more so the concepts within the Business Community actually driving the invasion. The employment of capital in the ai space or deployment of finance in the climate space and we can no longer afford to wait for government policy tew gree. That takes way too long so it has to be the culmination of business working together in the ecosystems to drive the change. To your point, the realty is, when business does this, it is not just what they do with themselves for themselves, it is what they do with themselves andwritten the ecosystem they operate and climate is a great example. Any individual company can make decisions but it isnt enough. What they need to do is deal can scope 3 and elements of the supply chain and they have to Work Together. It is a lot of Little Things that get scaled up to drive the change needed to be much more sustainable and achieve the goals looking to achieve. We cant afford to wait for a grand decision or Big Bang Theory that come through to save us. Small, but beautiful. Having said this, business communities have their own very specific interests and core issues to work with. For example, for financial benefit, that is always one of the goals of any business. How to make sure things like green washing, pr, mainly related to the so called discussions on ai governance, and also how would business work with political leaders with rules that prevent free trade and prevent the flow of data and consensus of data among business and between business and society . It is overloaded question. Lets take 2 examples. As you think of climate and green washing and elements of that you need a set of standards what should be reported and trust within that and accountability. To give people a senseif you look at the European Companies today, the top 50 there are rules and regulations what to support and system hasnt changed. The incentive for Management Changes have come to life. What is interesting and if you look at last years discussion, only one of 50 ceo had compensation impacted because they did not meet green objectives. One. It tells we are not putting enough emphasis on that or the setting of it goal was way too low. What do you think . I think it is a combination of the two that gets you there. The realty is, you have to change the entirety of the system. What is the strategy at a senior level . How do you incentivize the right behavior and how to survive and thrive . All most 60 percent of the ceo in this part of the pworld believe the businesses are not sustainable if they dont radically change in the next 10 years. They have to move with speed. They have to be agile to dial with policy decisions changing radically and uncertain and it will be the benefit of those Leadership Teams that actually are most agile and take advantage of opportunities and mitigate the downsize risk. Better data, quicker decision and less bureaucracy. That is important for corporate as much as government. Always a pleasure. Thank you so much. Appreciate it. Please rise and welcome to the stage his excellencyacy primary of malasia. Thank you everyone. Thank you mr. Prime minister. What a pleasure to see you again. Thank you. This morning you were working with colleagues to be here. There is a lot of things coming up every day we need to work so we will be both at the focus of our attention on the most important issues, and be able to look for solutions. Mr. Prime minister, therefore i want to ask you, what is your view of the state of the world . It is big question. Coming from political leaders mr. Prime minister. What does this region mean, Asian Pacific of bringing the best to the states of the world from your perspective . Thank you. Always start with easy question, not difficult within. [laughter] thank you for the opportunity. The assembly and the important players and roles. You start with this question about the [indiscernible] political leadsers and you want to [indiscernible] democracy and promote development, then the rule of the private sector, industry becomes more [indiscernible] more relevant, more critical now then ever before. Apec is one of the more significant and has to play dynamic role. There have been negative perceptions but i still believe apec is like the rock of gubraulter, it has to succeed and this is one that we have the [indiscernible] engage effectively. Im pleased last night when President Biden make reference looking forward to this engagement with president. Very important to take a different view. [indiscernible] Business Leaders must view this like the [indiscernible] Many Political leaders, therefore to my mind, we in the Asian Pacific look forward to this engagement because it is immense benefit to the region and to the world. As we speak, the meeting i guess is taking place right now somewhere near San Francisco, so what do you hope exact hope i just put it this way, this meeting bring to the discussions we are having right now . We talk about inclusivity, we talk about globalization. We accept that the Global Situation geo politics changed and we do acknowledge that. China has a role and has to be engaged effectively and there must be great effort to insure that it is part of the global community, and well based competition, but this engagement for example between President Biden is different. To me, it is critical because it should give a clear message that we are here to be able to Work Together and trust each other to resolve tedious problems, climate issue, ukraine or gaza. To too many contentious issues in the world and you must try to engage accepting the fact that you may not achieve all the desired results. This engagement is important to try and establish areas and Work Together. Countries like malasia cannot be forced to see the world and big powers in the whole world mindset. United states, traditionally has done immense task in the early phase of development. The total example, the total investments and trade with malasia is lead by the united states. Things are changing. There is increasing investment to china, so why put us in the fix and zero sum game for the benefit of countries . Emerging economics and also for the west and the east. I believe that the solution is of course greater collaboration, and this said must end because the world and post normal times is more [indiscernible] more complex and full of [indiscernible] it requires leaders with vision, with commitment, with shared ideals to resolve it effectively. [applause] do you think your idea is representative of colleagues . Well, we have consensus, even more contentious issues like [indiscernible] there are differences, but we all share the view that it must not be unjust, it must not discriminate, it must not continue with atrocities against your own people, so there is a point of consensus. Similarly, china, there are different level of emphasis, but generally we want to preserve the region, the most vibrant economic region as independent. I use the term, fiercely independent to express our views, to share our concerns, but to accept the thought, realty. United states and the west remain a very important ally to us and china is very important trusted neighbor that would have in our attempt to prepare the economy and insure a peaceful vibrant region economically. Lets talk about the economy, mr. Prime minister. You and your scalleges have worked on thatd in your country but looking at the region we see important mechanisms working extremely well in the asian Pacific Region. [indiscernible] is one of those and also we see rcep as well. How do you see these trade mechanisms are helping us and moving forward . We know difficulties, but still how can we maintain a certain level of stability and predictability . Earlier you heard mr. Moriz coming from the business perspective asking for that as Business Leader. Mr. Prime minister. I dont think we have a choice. [indiscernible] 9, 10 percent gross and even Budget Surplus in the 90s, because it was a trading nation, and through [indiscernible] the fda we have, the more beneficial for the countries. We should utilize. I believe countries must be able to engage more and accept the fact that an arrangement is more beneficial and that means countries cannot be marginalized or discriminated for reasons for other reasons, [indiscernible] whatever, that is my position and i think most countries share this view. Lets talk about some of the synergy among economy in the asian Pacific Region. We see there is a debate about the so called global north and global south, but actually, between the north and south and among the south itself there is tremendous synergy going on. I could put on the example between mulasa malasa and china but that is one example. How do you see the synergy taking place, despite the fact we have issues politically for the world . [indiscernible] i always stress on the new realty, that the old mindset of the cold war must end. It does not mean it ended. Look at the [indiscernible] what is our concern . [indiscernible] committed to pay hundreds of billion and not forthcoming. So many positions of economics and i think to me it is unhealthy we. Need to therefore have a mechanism that we will not have this sort of division. Now, thats why i sayi still maintain the only way forward is to see us as one community. Climate change is not puculiar to the west or east. We all suffer. [indiscernible] this issue should not be allowed to further divide. [indiscernible] we must have a common vision, including the private sector. I dont believe thati see the new dynamics and analysis on csr and inclusivity and [indiscernible] better wagers for workers, on issues of climate. These are universal concerns. What we lack in politics, in business in my humble view is lack of humanity, lack of compassion. We compartmentalize people. We [indiscernible] and i think this has to change. Im appealing to you to help us in this cause, with this cause. [indiscernible] you cant depend on to the political leaders, because they have been entrusted and to some extent exceeded, but also failed. The private sector should pay a more dominant and assertive role along with society to make sure whether you call democracy or participatory democracy or People Engagement works. I state my case. How would you be of support for that . We see countries different one from another where you encourage business communities to engage more. The business communities also have their core issues to work out. For example, how to make the business healthy. The political leaders have to be accountable and also has to be supported. Providing the platform for everybody, including many Business Leaders here. Business leaders too. I have been quite unpopular in some remarks when we had thisto deal with this scandal. I said, it would not have happened without the complicity or [indiscernible] goldman sachs. I think we must have humility to accept things have to change and to acknowledge that we had limitations and on humility, my standard code is from ts elliot. The only wisdom we can hope to acquire is the wisdom of humility, and humility is endless. Let us accept the fact in order to insure that we resolve major outstanding issues of the world from ai that we heard just now, to Climate Change, to [indiscernible] we have to make the necessary adjustments, and accept the fact that either in democracy you talked about democratic accountability. It isnt just elections every 5 years, so accountability isnt only among political leaders, but business and Civil Society leaders. Interesting enough, one of the traditions of the profit mohammed which we learned from early age is that all of you are responsible and all of you without exception is accountable for your action and your deeds. Of course the next question is, do people actually implement these principals . Of course, no. I think can weyou are right in saying that we all should be accountable. For a government, what do we do . We have a framework. There is clarity in policies and acknowledge the fact the country cannot move forward without involvement of the private sector, without foreign investment, so all possible avenues including census must be brought to insure that it is better employment is addressed. With clarity in policies, including Energy Transition issue over Digital Transformation has got to be clearly laid down and our task with the bureaucracy is to effectively implement this stow the private sector understand clearly what is to be expected for any of the countries. Thank you. Mr. Prime minister, i really enjoyed the quotes you had from the saints and the poets. They are providing a lot of inspiration for us, but i have to be pragmatic in my question. We are seeing the coming year, 2024 with many elections going on in the world. These economies big, small, and yet there is always an issue of how political leaders will work on their domestic agenda, the state of the world. So, being a responsible player, from your perspective, representing the political leaders, what are some of the important steps you see that are crucial these days for political leaders . Of course, [indiscernible] the statesman, plans for the next generation. [indiscernible] for the next elections. We see more statesman or more politicians . I think it needs to combine both. You think of the next generation you would lose the elections. [laughter] if you only see the next elections you condemn the next election. I think it is important to make sure that both of these concerns are met. People do understand the vision, the policies and political decisions however popular cannot condemn the next generation. I am fortunate in this because we have secured comfortable majority in parliament and my election is another 4 years. [indiscernible] make for malasia. I see you are talking from a very neutral perspective right now. Mr. Prime minister, now we are at a important crossroad. The economy whether big or small or middle size economies are all trying to strive with the circumstances they have to deal with. What do you think are some of the most important tools for political leaders like you to work with your business communities and also work on the economic partnerships with your friends and partners in the asian Pacific Region . From my limited experience, in the early period of the 90 as minister and now i think political [indiscernible] is very critical. But clarity of policy is what is required. Consistent clear policy, whether energy or [indiscernible] program or investments. Then of course, effective implement vision. We all talk about ease of doing business. We all talk about one stop agency and it used [indiscernible] one stop agency does not mean it stops there. It means that you have to facilitate the process with clear procedures and policies and i think if that is doneim very fortunate, from china, united states, europe and the region we have established a record investments far exceed our projections. Im talking about real huge and this signifies a confidence of the private sector to the way we set policies and we do business. My take based on our past experience is good governance. We must be [indiscernible] policy and [indiscernible] against corruption and this way of doing business squandering public funds to enrich those in power and that is made very clear i think we are on the right track to propel economy and count wrae ry in next few years. Very ambitious and think the last 6, 7 mujts we can achieve that. Before we go, we only have 30 seconds to go, mr. Prime minister. How political leaders like you and your colleagues, to make sure that you are not being hijacked by rhetoric and able to focus on the real issue and responsible for the next generation as you said from mr. Churchill . It is not [indiscernible] because finally you are judged by your action. People give allowance the first few months, but then they have to see whether you mean business. All political leaders, come up and obtain power by fighting corruption and abuse of power. The test is when you in the responsible position whether you can really deliver. The second of course, clear economic policies and you are right, because people becomethat is why i started with deficit against political leaders, because the [indiscernible] is not met with concrete action, and thank you very much again. I need your support. Malasia is the most stable and vibrant place to invest and i look forward meeting you individually in malasia. Thank you so much. Thank you so much mr. Prime minister. Appreciate it. It did take a village. I was really lucky when i was 14 years old to get an internship. The difference that it made for me is i had a job, but there were other people who didnt have a job, who, unfortunately, needed money. And they were shown to commit illegal acts to get money. That is what i want to prevent. [ ] today we are here to officially kick off the first class of opportunities for all. [applause]. Opportunities for all is a program that mayor breed launched in october of 2018. It really was a vision of mayor breed to get to all of the young people in San Francisco, but with an intention to focus on young people that have typically not being able to access opportunities such as internships or workbased learning opportunities. Money should never be a barrier to your ability to succeed in life and that is what this program is about. Theres always these conversations about young people not being prepared and not having experience for work and if they dont get an opportunity to work, then they cannot gain the experience that they need. This is really about investing in the future talent pool and getting them the experience that they need. It is good for everyone because down the road we will need future mechanics, future pilots, future bankers, future whatever they may be in any industry. This is the pipe on we need to work with. We need to start developing talent, getting people excited about careers, opening up those pathways and frankly giving opportunities out there that would normally not be presented. [ ] the way that it is organized is there are different points of entry and different ways of engagement for the young person and potential employers. Young people can work in cohorts or in groups and thats really for people that have maybe never had job experience or who are still trying to figure out what they want to do and they can explore. And in the same way, it is open for employers to say, you know what, i dont think we are ready to host an intern yearround are all summer, but that they can open up their doors and do site visits or tours or panels or conversations. And then it runs all the way up to the opportunity for young people to have longterm employment, and work on a project and be part of the employee base. Something new, to get new experience and meet people and then you are getting paid for it you are getting paid for doing that. It is really cool. I starting next week, i will be a freshman. [cheers and applause] two of the things i appreciate about this program was the amazing mentorship in the job experience that i had. I am grateful for this opportunity. Thank you. Something i learned at airbnb is how to network and how important it is to network because it is not only what you know, but also who you know to get far in life. During this program, i learned basic coding languages, had a had to identify the main components and how to network on a corporate level. It is also helping me accumulate my skills all be going towards my College Tuition where i will pursue a major in computer science. For myself, being that i am an actual residential realtor, it was great. If anybody wants to buy a house, let me know. Whenever. [applause] it is good. I got you. It was really cool to see the commercial side and think about the process of developing property and Different Things that i can explore. Opportunities for all was a great opportunity for all. We were aiming to have 1,000 young people register and we had over 2,000 people register and we were able to place about between 50 and did. We are still getting the final numbers of that. Over several weeks, we were able to have students participate in Investment Banking they were able to work with our team, or technology team, our engineering 20 we also gave them lessons around the industry, around financial literacy. There are 32,000 young people ages 16 and 24 living in San Francisco. And imagine if we can create an opera skin it just opportunity for all program for every young person that lives in public housing, affordable housing, low income communities. It is all up to you to make that happen. We have had really great response from employers and they have been talking about it with other employers, so we have had a lot of interest for next year to have people sign on. We are starting to figure out how to stay connected to those young people and to get prepared to make sure we can get all 2400 or so that registered. We want to give them placement and what it looks like if they get more. Lets be honest, there is always a shortage of good talent in any industry, and so this is a real great career path. For potential sponsors who might be interested in supporting opportunities for all , there is an opportunity to make a difference in our city. This is a really thriving, booming economy, but not for everyone. This is a way to make sure that everyone gets to benefit from the great place that San Francisco is and that we are building pathways for folks to be able to stay here and that they feel like they will belong. Just do it. Sign up for it. [ ] [ ]story. Hi he my name is dean pes continue district 5 supervise and congratulate it sfgovtv on their thirty Year Anniversary thank you, so much for bringing transparency and accountability to government and for all you do happy anniversary. On behalf of all we want to say thank you, sfgovtv thank you for being here. And your help in the womens Leadership Convention and congratulations sfgovtv on our thirty years of service the office of Government Affairs he happy to partner i love teaching. It is such an exhilarating experience when people began to feel their own creativity. This really is a place where all people can come and take a class and fill part of the community. This is very enriching as an artist. A lot of folks take these classes and take their digital imagery and turn it into negatives. There are not many black and white darkrooms available anymore. That is a really big draw. This is a signature piece. This is the bill largest darkroom in the u. S. There are a lot of people that want to get into that dark room. I think it is the heart of this place. You feel it when you come in. The people who just started taking pictures, so this is really an intersection for many generations of photographers and this is a great place to learn because if you need people from different areas and also everyone who works here is working in photography. We get to build the community here. This is different. First of all, this is a great location. It is in a lesspopulated area. Of lot of people come here just so that they can participate in this program. It is a great opportunity for people who have a little bit of photographic experience. The people have a lot, they can really come together and share a love and a passion. We offer everything from traditional black and white darkrooms to learning how to process your first roll of film. We offer classes and workshops in digital camera, digital printing. We offer classes basically in the shooting, ton the town at night, treasure island. There is a way for the programs exploring everyone who would like to spend the day on this program. Hello, my name is jennifer. My name is simone. We are going on a field trip to take pictures up the hill. Cmon, cmon, cmon. Actually, i have been here a lot. I have never looked closely enough to see everything. Now, i get to take pictures. We want to try to get them to be more creative with it. We let them to be free with them but at the same time, we give them a little bit of direction. You can focus in here. That was cool. If you see that . Behind the city, behind the houses, behind those hills. The see any more hills . These kids are wonderful. They get to explore, they get to see Different Things. We let them explore a little bit. They get their best. If their parents ever ask, we can learn they can say that they learned about the depth of field or the rule of thirds or that the shadows can give a good contrast. Some of the things they come up with are fantastic. That is what were trying to encourage. These kids can bring up the creativity and also the love for photography. A lot of people come into my classes and they dont feel like they really are creative and through the process of working and showing them and giving them some tips and ideas. This is kind of the best kept secret. You should come on and take a class. We have orientations on most saturdays. This is a really wonderful location and is the real jewel to the community. Ready to develop your photography skills . The Harvey Milk Photo Center focuses on adult classes. And saturday workshops expose youth and adults to photography classes. December 7, 2023 regular meeting of government audit oversight committee. Im supervisor dean preston, chair, here with vice chair stefani and supervisor chan. The clerk today is victor young and thanks to sf gov tv forstaffing the meeting. Public comment will be taken on each item. Please line up on your right. You may submit Public Comment in writing email to [indiscernible] if you submit via email it is included as part of the file