Transcripts For CSPAN3 Current Pentagon Officials Discuss In

That for the plenaries here and the maryland ball room, you can email questions to the panel. And hopefully well have a logo up that says questions intelsummit. Org. Lair is going to get your questions. By the miracle of technology, theyre going to appear on an ipad with vince here. Vince, if you didnt get the word, at some point larrys going to tell you last question, okay . So, its now my pleasure to introduce the moderator of our Defense Intelligence plenary Lieutenant General vincent stewart, u. S. Marine corps come on, come on retired. Thats the part i was waiting for. And vince is the founder and ceo of stewart global solutions, an International Consulting firm. He retired from the u. S. Marine corps in april of this year after more than 38 years of service to the nation. So, join me in thanking vince for his service. A career intelligence officer, vince served as the 20th director of the Intelligence Agency where he was the first africanamerican, the first jamaican american, and the first marine to hold the position of director dia. General stewart earned degrees in National Strategic studies from the Naval War College and war strategies from the defense university. Please join me in welcoming former director, good friend of industry and my friend, Vince Stewart to the stage. Over to you, vince. All right. I dont usually let folks waffle on about my career like this, but since this is chucks last time, i let him get away with that a little bit. Thank you all for joining us this afternoon. Weve got a distinguished panel here this afternoon. If you dont know them, youre in the wrong place. Im not going to ask them to do an introduction, tell you who they are and where theyre from. Youve got deputy secretary under the armed forces, jeff kruse, and jake. I want to go through a quick round of questions. I want you to have your questions ready for follow up. What ill do with the question ts is give them a chance to set the stage, talk about their highest priorities, what their concerns are, how the industry could help. And then maybe on the back end well ask the question i used to get all the time what keeps you awake at night. So, well do a tablesetting kind of sessions and well follow up and well do this kind of quick pace, fast break basketball. So, if a question is answered and we dont like the answer, we want to follow up, well jump right in. So, were going to start with ms. Bingam. Lots of conversation about Machine Learning and the implications for the Intelligence Community. Youve drived project maven as the pathfinder for Machine Learning. Can you give the audience a sense of where we are with project maven, jake, some of the challenges youve seen, and some of the ways we can be helpful as partners . Sure, vince. Thank you. Its great to be here. Love this event every year. Im really happy to be here participated. So, maven. I always love the chance to talk about maven and Artificial Intelligence Machine Learning. I like to preface it by saying were at the infancy, the Machine Learning phase. We would like to get to ai but we have a ways to go. Maven is a pathfinder. When we were here about two years ago, we were on track for within six months of authority to proceed to get an initial minimum viable product capability out to the field. Since that time, they have scaled pretty significantly in terms of increasing algorithm performance, scaling geographic locations. My boss was just out in theater a couple weeks ago and got to see it in action. Scaling across different isr platforms, were in dozens of legacy platforms now. And then scaling across different missionaries, not just full motion video but other area of intel. So, were proud of that but have a tremendous amount of work to go. Just a couple of points to make on what were learning because i think the key about being a pathfinder is you learn and apply that to broader activity that is the jake in particular is undertaking. One, i would say get your users involved early. This is for us, its been all about fielding, get that minimum viable product which this is Agile Development and practice. Get that out to the field, work with the users, and build from there, scale it from there. Second thing i would say is where weve learned the most has been in what we call the ai pipeline. So, writing the algorithms probably the easiest part. Its the upfront data access, data labelling which is incredibly manual, integrating at the back end in the weapons systems, doing the accreditation of all these different dod system ls. So, those are the big areas where were learning. Now as we go into this year, weve got almost two years under our belt now, its out there in enough capability that we need to now see change. We need to see work force changes. We need to see efficiencies. We need to see cultural changes as a result of bringing ai into the field. Thats what were looking for in the next year. Okay. Thanks. Susan, much has been said about the building of the analyst of the future. While the analytic trade craft will largely remain the same, the analyst of the future will still be inundated by a vast amount, growing amount of data. With all that data that the analysts will have to swim their way through, whats dia doing to think about big data analytics, and where does mars, a program we all hear about, fit into this analytic framework . So, there is no question that analyst of the future is something that dia is trying to hone in on and define more specifically. Clearly Mission Number one is providing the analytic assessments to all of our customer base, timely, accurate, insightful, comprehensive understanding of the information out there, providing insight, and ideally understanding the operational environment. But youre right, the data thats available to the analyst to craft those assessments only increases by the minute. Not only that, but the operating environments that we have to assess are evolving. Space is a great example of that. So, the types of data and the exquisiteness of that data are increasingly challenge for our analysts. You named mars as certainly top of the list, if you will, of the initiatives that dia is undertaking to try to help our analysts make sense of all that information and fundamentally deliver more insights. So, mars is step one. For those in the room who may not be that familiar, its our effort to really develop and expand the data environment in which our analysts it accesses many more databases in one fail swoop, if you will, allows for additional databases we dont currently have in an automated fashion, and hopefully well leverage Ai Technologies as they mature to allow more rapid and creative insights on the part of the analyst. Mars is not it. Were doing much more in the realm of open source intelligence. Open source has been around for quite some time. What dia is doing new is structuring our effort against open source. Even just earlier this year, general ashley made some decisions to establish more efficiently a career path if you will for open source cloak tors and dia. Were establishing an open source integration center, putting efrpts around pockets in the enterprise. The intent there is to bring increased discipline around the activities that many of our analysts and collectors are undertaking now to drive some maturity into that process and ultimately to allow the analyst to leverage open source in a much more official trade craft compliant and useful way. So, thats number two that i would highlight. And then finally i would highlight jox. None of this happening none of this is effective without a strong jox foundation. Jox has been around for 25 years and has to continue to evolve to meet the customer demands which are only increasing even outside the ic user abase. The types of things people are using jox for is modernizing. Were undertaking investments and approaches to do exactly that. The time is now given the need to support mars, to support osent and over all futures. Im probably going to come back to jwix later. Im going to skip jeff for just a second because admiral whitworth and i talked about the challenges of produces intelligence in a timely manner in this environment. And one of the things as susan was talking about, i was thinking about when was the last time we used the National Intelligence estimate . Thats a pretty static document. Its almost obsolete at the point of publication. Can you talk a little bit about the challenges of generating Real Time Intelligence in an estimated sort of environment, in a spiral sort of talk about some of the challenges of developing intelligence in this crazy world, randall. Yes, sir. Thank you for that question. The chairman and the joint staff have made it clear we need to focus on global integration. Were not going to look at just regional. Were going to look at opportunity as it applies to other adversaries, taking advantage. That creates so many permutations of potential estimates. So, to your point, when we draw, lets say, a National Intelligence estimate or something that just stays on the shelf as the 2019 edition, when youre trying to get that integrated and that global, presents a problem. How do you go back and fill in variables that contributed to that particular estimate with some real time urgency and speed . Enter what we were classifying as our giant concept for intelligence operations to. Your point, its a spiral estimate. Its basically trying to get going with multiple variables so we can rest assured that at least at some juncture all of the data is being looked at. Were being queued to possibly reassess for a new estimate. So, in case our Industry Partners didnt pick up on that, static assessments, the static summaries that drive Decision Making doesnt fit in the modern very dynamic world. How does industry help us to build that very dynamic spiral estimate as the world changes, as the variables changes, how do we see those different permutations so that that drives Decision Making at the policy and strategic level . So, thats an area that just having almost every publication that we put out there as intel estimates begins to be obsolete at time of printing. How do we make that more dynamic . Thats the requirement. Im going to leverage jeff a little bit here. Ive heard lots of questions today and comments about Great Power Competition. Jeff spent three years as a j 2. He got to see one of the great powers carry out its strategy. Im going to ask jeff to just kind of help us characterize the challenges you saw on the front end of the Pacific Command specifically as china walked through its strategy. So, ill give you an extra 30 seconds so you can its an easy one for any good intel officer. Let me add my thanks to everyone joining us today. Great conversations and thank you sir. I think i would preface my conversation with china and the same pay com turned into pay come. In 2014 and 2015 i happened to be running for general in yukon and working through problems russia was going through, conducted a handful of operations they wanted to do under a certain amount of cover. And the question for us is how do you illuminate that, and how do you kwens the rest of your allies and partners or your own department of defense the threat that in this case russia presented . The second piece is way back when, if you go back ten years when i was a student at the national art college, we had a piece of china, two column by two rows and it was china continuing to rise and china unable to maintain that momentum, and china being friendly to western powers or china being an adversary. A decade ago, nobody was picking the quadrant of china being able to sustain its rise internationally, economically, and militarily while still presenting a challenge to the international order. 2016, show up in pay com which is probably where you wanted me to start this story, and the first piece that i really came to grips world war all the assessment that assessments that we made a decade previously, china had far surpassed those estimations. We used to rely on a handful of things about china, that we had qualitative and quantitative and experiential ability to do whatever they needed to do and go beyond. We were far more advanced in the all of the areas that mattered. It turns out china had spent five, maybe six fiveyear plans methodically over the years systematically addressing the areas where we had an advantage over the years that they could observe. So, the first piece, my first probably 12 to 18 months was illuminating and really understanding where china is in that journey that they were on and what kind of threat it presented. So, great partnerships with the national community. And it is remarkable what china was able to do in that period of time. The period at the tail end of that first 12 to 18 months was the crafting of the new National Defense strategy. So, that really paralleled back to how do we convince the rest of the department of what china looks like and what are their goals and objectives Going Forward . And the piece that i would offer to you is that at the macro level, i consider china an open book. Theyre academic right, they plan as a nation, and they move out in a very large way in a public fashion. We know their National Objectives are to restore or achieve regional, to displace the u. S. As a global power, and to change some of the International Organizations out there to be more advantageous to chinas authoritarian model. So, if we know that, it becomes then what we worked on for the second 18 months which is the hard part, what do you do about it . So, the piece i would offer to the crowd here is that while we used to rely on china being able to build a lot of stuff but not being able to train with it, not being joint enough, they have worked through all of those issues and they are presenting as we have seen in the most recent exercise which concluded not that long ago a very dynamic capability to employ high end equipment against a scenario that should cause a variety of regional partners to take note of what theyre attempting to do. I would say china has tried to keep their intentions below the radar scope so it doesnt elicit the kind of response that we would normally take. And they were certainly counting on an ability to use ties in the academic business and other communities to make it challenging for the United States to make some decisions about what were going to do to address that. So, where we sit today in my view and the challenge for all of us is what is it that we can do today. Were in the competition space today. China would certainly like us to take a little to no action, to focus on the urgent versus the longterm issue. And i think what i would offer is the important piece for us is to understand Great Power Competition and do well in that conflict today, posture ourselves so, you know, two, four, five, twenty years from now we dont find ourselves in a position we dont want. Just tee it up that way. I would love to jump on that. We do have a new secretary, deputy secretary. The good thing is here theyve maintained our departmentwide focus on the National Defense strategies, so were not seeing any changes there. Prioritizing china and russia and modernization. I think jeff hit it on the head is we are in this strategic competition phase right now. And, you know, the department, we do order battle well, we do force well, we buy aircraft and tanks and ships well. Its that gray zone space that we dont do as well. Its looking at the nexxus between economic and National Security. I think about chinas one belt one road initiative. Military planners really care about whos operating what ports well. Care about whos operating railways. We care about resilient communications, telecon networks. So, all of these things are happening now. And if we cant effectively be present and counter in that competitive and frankly economic space, youre setting yourselves up for not being as successful if and when the balloon goes up. Just another thing i mention there is Just Technology theft as well as jeff hit on this too. Were seeing them in a pretty concerted effort go after specific technologies. In the past weve been fortunate to be able to maintain that technology and the military advantage. When youre stealing it now, were going to see the same technology that were doing r d on now, well face it five or ten years from now on the battlefield. So, that Technology Advantage is eroding. So, were doing a lot more on the security front to address that. Is there something industry can do to help us in securing that technology and managing the supply chain so that china doesnt take advantage of the great r d that we do . What are the things we would like industry to do . Ill put that up as a jump ball. Im sorry. So, the supply Chain Insights transparency management is increasingly a concern for us. Obviously weve been focused on it particularly in the it space for years. What were finding is thats not enough. Thats too narrow of a viewpoint. Weve tried to certainly open our aperture and work more closely with industry part fer hads to understand the entirety of the supply chain coming through the dia doors in our case and understanding the tangents that each of the supply chains go into. Its daunting. Theres no question about it. But we have to do it. And were increasingly looking to our vendors to come to us with transparent display, if you will, of your supply chain so that we can understand it, so that ecowith have confidence in it and really make sure that everything that comes through the front door is uncompromised throughout, whether its equipment. It could be cameras, chairs, furniture, i. T. Equipment, i could go on. We have to think more seriously and Defense Intelligence<\/a> plenary Lieutenant General<\/a> vincent stewart, u. S. Marine corps come on, come on retired. Thats the part i was waiting for. And vince is the founder and ceo of stewart global solutions, an International Consulting<\/a> firm. He retired from the u. S. Marine corps in april of this year after more than 38 years of service to the nation. So, join me in thanking vince for his service. A career intelligence officer, vince served as the 20th director of the Intelligence Agency<\/a> where he was the first africanamerican, the first jamaican american, and the first marine to hold the position of director dia. General stewart earned degrees in National Strategic<\/a> studies from the Naval War College<\/a> and war strategies from the defense university. Please join me in welcoming former director, good friend of industry and my friend, Vince Stewart<\/a> to the stage. Over to you, vince. All right. I dont usually let folks waffle on about my career like this, but since this is chucks last time, i let him get away with that a little bit. Thank you all for joining us this afternoon. Weve got a distinguished panel here this afternoon. If you dont know them, youre in the wrong place. Im not going to ask them to do an introduction, tell you who they are and where theyre from. Youve got deputy secretary under the armed forces, jeff kruse, and jake. I want to go through a quick round of questions. I want you to have your questions ready for follow up. What ill do with the question ts is give them a chance to set the stage, talk about their highest priorities, what their concerns are, how the industry could help. And then maybe on the back end well ask the question i used to get all the time what keeps you awake at night. So, well do a tablesetting kind of sessions and well follow up and well do this kind of quick pace, fast break basketball. So, if a question is answered and we dont like the answer, we want to follow up, well jump right in. So, were going to start with ms. Bingam. Lots of conversation about Machine Learning<\/a> and the implications for the Intelligence Community<\/a>. Youve drived project maven as the pathfinder for Machine Learning<\/a>. Can you give the audience a sense of where we are with project maven, jake, some of the challenges youve seen, and some of the ways we can be helpful as partners . Sure, vince. Thank you. Its great to be here. Love this event every year. Im really happy to be here participated. So, maven. I always love the chance to talk about maven and Artificial Intelligence<\/a> Machine Learning<\/a>. I like to preface it by saying were at the infancy, the Machine Learning<\/a> phase. We would like to get to ai but we have a ways to go. Maven is a pathfinder. When we were here about two years ago, we were on track for within six months of authority to proceed to get an initial minimum viable product capability out to the field. Since that time, they have scaled pretty significantly in terms of increasing algorithm performance, scaling geographic locations. My boss was just out in theater a couple weeks ago and got to see it in action. Scaling across different isr platforms, were in dozens of legacy platforms now. And then scaling across different missionaries, not just full motion video but other area of intel. So, were proud of that but have a tremendous amount of work to go. Just a couple of points to make on what were learning because i think the key about being a pathfinder is you learn and apply that to broader activity that is the jake in particular is undertaking. One, i would say get your users involved early. This is for us, its been all about fielding, get that minimum viable product which this is Agile Development<\/a> and practice. Get that out to the field, work with the users, and build from there, scale it from there. Second thing i would say is where weve learned the most has been in what we call the ai pipeline. So, writing the algorithms probably the easiest part. Its the upfront data access, data labelling which is incredibly manual, integrating at the back end in the weapons systems, doing the accreditation of all these different dod system ls. So, those are the big areas where were learning. Now as we go into this year, weve got almost two years under our belt now, its out there in enough capability that we need to now see change. We need to see work force changes. We need to see efficiencies. We need to see cultural changes as a result of bringing ai into the field. Thats what were looking for in the next year. Okay. Thanks. Susan, much has been said about the building of the analyst of the future. While the analytic trade craft will largely remain the same, the analyst of the future will still be inundated by a vast amount, growing amount of data. With all that data that the analysts will have to swim their way through, whats dia doing to think about big data analytics, and where does mars, a program we all hear about, fit into this analytic framework . So, there is no question that analyst of the future is something that dia is trying to hone in on and define more specifically. Clearly Mission Number<\/a> one is providing the analytic assessments to all of our customer base, timely, accurate, insightful, comprehensive understanding of the information out there, providing insight, and ideally understanding the operational environment. But youre right, the data thats available to the analyst to craft those assessments only increases by the minute. Not only that, but the operating environments that we have to assess are evolving. Space is a great example of that. So, the types of data and the exquisiteness of that data are increasingly challenge for our analysts. You named mars as certainly top of the list, if you will, of the initiatives that dia is undertaking to try to help our analysts make sense of all that information and fundamentally deliver more insights. So, mars is step one. For those in the room who may not be that familiar, its our effort to really develop and expand the data environment in which our analysts it accesses many more databases in one fail swoop, if you will, allows for additional databases we dont currently have in an automated fashion, and hopefully well leverage Ai Technologies<\/a> as they mature to allow more rapid and creative insights on the part of the analyst. Mars is not it. Were doing much more in the realm of open source intelligence. Open source has been around for quite some time. What dia is doing new is structuring our effort against open source. Even just earlier this year, general ashley made some decisions to establish more efficiently a career path if you will for open source cloak tors and dia. Were establishing an open source integration center, putting efrpts around pockets in the enterprise. The intent there is to bring increased discipline around the activities that many of our analysts and collectors are undertaking now to drive some maturity into that process and ultimately to allow the analyst to leverage open source in a much more official trade craft compliant and useful way. So, thats number two that i would highlight. And then finally i would highlight jox. None of this happening none of this is effective without a strong jox foundation. Jox has been around for 25 years and has to continue to evolve to meet the customer demands which are only increasing even outside the ic user abase. The types of things people are using jox for is modernizing. Were undertaking investments and approaches to do exactly that. The time is now given the need to support mars, to support osent and over all futures. Im probably going to come back to jwix later. Im going to skip jeff for just a second because admiral whitworth and i talked about the challenges of produces intelligence in a timely manner in this environment. And one of the things as susan was talking about, i was thinking about when was the last time we used the National Intelligence<\/a> estimate . Thats a pretty static document. Its almost obsolete at the point of publication. Can you talk a little bit about the challenges of generating Real Time Intelligence<\/a> in an estimated sort of environment, in a spiral sort of talk about some of the challenges of developing intelligence in this crazy world, randall. Yes, sir. Thank you for that question. The chairman and the joint staff have made it clear we need to focus on global integration. Were not going to look at just regional. Were going to look at opportunity as it applies to other adversaries, taking advantage. That creates so many permutations of potential estimates. So, to your point, when we draw, lets say, a National Intelligence<\/a> estimate or something that just stays on the shelf as the 2019 edition, when youre trying to get that integrated and that global, presents a problem. How do you go back and fill in variables that contributed to that particular estimate with some real time urgency and speed . Enter what we were classifying as our giant concept for intelligence operations to. Your point, its a spiral estimate. Its basically trying to get going with multiple variables so we can rest assured that at least at some juncture all of the data is being looked at. Were being queued to possibly reassess for a new estimate. So, in case our Industry Partners<\/a> didnt pick up on that, static assessments, the static summaries that drive Decision Making<\/a> doesnt fit in the modern very dynamic world. How does industry help us to build that very dynamic spiral estimate as the world changes, as the variables changes, how do we see those different permutations so that that drives Decision Making<\/a> at the policy and strategic level . So, thats an area that just having almost every publication that we put out there as intel estimates begins to be obsolete at time of printing. How do we make that more dynamic . Thats the requirement. Im going to leverage jeff a little bit here. Ive heard lots of questions today and comments about Great Power Competition<\/a>. Jeff spent three years as a j 2. He got to see one of the great powers carry out its strategy. Im going to ask jeff to just kind of help us characterize the challenges you saw on the front end of the Pacific Command<\/a> specifically as china walked through its strategy. So, ill give you an extra 30 seconds so you can its an easy one for any good intel officer. Let me add my thanks to everyone joining us today. Great conversations and thank you sir. I think i would preface my conversation with china and the same pay com turned into pay come. In 2014 and 2015 i happened to be running for general in yukon and working through problems russia was going through, conducted a handful of operations they wanted to do under a certain amount of cover. And the question for us is how do you illuminate that, and how do you kwens the rest of your allies and partners or your own department of defense the threat that in this case russia presented . The second piece is way back when, if you go back ten years when i was a student at the national art college, we had a piece of china, two column by two rows and it was china continuing to rise and china unable to maintain that momentum, and china being friendly to western powers or china being an adversary. A decade ago, nobody was picking the quadrant of china being able to sustain its rise internationally, economically, and militarily while still presenting a challenge to the international order. 2016, show up in pay com which is probably where you wanted me to start this story, and the first piece that i really came to grips world war all the assessment that assessments that we made a decade previously, china had far surpassed those estimations. We used to rely on a handful of things about china, that we had qualitative and quantitative and experiential ability to do whatever they needed to do and go beyond. We were far more advanced in the all of the areas that mattered. It turns out china had spent five, maybe six fiveyear plans methodically over the years systematically addressing the areas where we had an advantage over the years that they could observe. So, the first piece, my first probably 12 to 18 months was illuminating and really understanding where china is in that journey that they were on and what kind of threat it presented. So, great partnerships with the national community. And it is remarkable what china was able to do in that period of time. The period at the tail end of that first 12 to 18 months was the crafting of the new National Defense<\/a> strategy. So, that really paralleled back to how do we convince the rest of the department of what china looks like and what are their goals and objectives Going Forward<\/a> . And the piece that i would offer to you is that at the macro level, i consider china an open book. Theyre academic right, they plan as a nation, and they move out in a very large way in a public fashion. We know their National Objectives<\/a> are to restore or achieve regional, to displace the u. S. As a global power, and to change some of the International Organizations<\/a> out there to be more advantageous to chinas authoritarian model. So, if we know that, it becomes then what we worked on for the second 18 months which is the hard part, what do you do about it . So, the piece i would offer to the crowd here is that while we used to rely on china being able to build a lot of stuff but not being able to train with it, not being joint enough, they have worked through all of those issues and they are presenting as we have seen in the most recent exercise which concluded not that long ago a very dynamic capability to employ high end equipment against a scenario that should cause a variety of regional partners to take note of what theyre attempting to do. I would say china has tried to keep their intentions below the radar scope so it doesnt elicit the kind of response that we would normally take. And they were certainly counting on an ability to use ties in the academic business and other communities to make it challenging for the United States<\/a> to make some decisions about what were going to do to address that. So, where we sit today in my view and the challenge for all of us is what is it that we can do today. Were in the competition space today. China would certainly like us to take a little to no action, to focus on the urgent versus the longterm issue. And i think what i would offer is the important piece for us is to understand Great Power Competition<\/a> and do well in that conflict today, posture ourselves so, you know, two, four, five, twenty years from now we dont find ourselves in a position we dont want. Just tee it up that way. I would love to jump on that. We do have a new secretary, deputy secretary. The good thing is here theyve maintained our departmentwide focus on the National Defense<\/a> strategies, so were not seeing any changes there. Prioritizing china and russia and modernization. I think jeff hit it on the head is we are in this strategic competition phase right now. And, you know, the department, we do order battle well, we do force well, we buy aircraft and tanks and ships well. Its that gray zone space that we dont do as well. Its looking at the nexxus between economic and National Security<\/a>. I think about chinas one belt one road initiative. Military planners really care about whos operating what ports well. Care about whos operating railways. We care about resilient communications, telecon networks. So, all of these things are happening now. And if we cant effectively be present and counter in that competitive and frankly economic space, youre setting yourselves up for not being as successful if and when the balloon goes up. Just another thing i mention there is Just Technology<\/a> theft as well as jeff hit on this too. Were seeing them in a pretty concerted effort go after specific technologies. In the past weve been fortunate to be able to maintain that technology and the military advantage. When youre stealing it now, were going to see the same technology that were doing r d on now, well face it five or ten years from now on the battlefield. So, that Technology Advantage<\/a> is eroding. So, were doing a lot more on the security front to address that. Is there something industry can do to help us in securing that technology and managing the supply chain so that china doesnt take advantage of the great r d that we do . What are the things we would like industry to do . Ill put that up as a jump ball. Im sorry. So, the supply Chain Insights<\/a> transparency management is increasingly a concern for us. Obviously weve been focused on it particularly in the it space for years. What were finding is thats not enough. Thats too narrow of a viewpoint. Weve tried to certainly open our aperture and work more closely with industry part fer hads to understand the entirety of the supply chain coming through the dia doors in our case and understanding the tangents that each of the supply chains go into. Its daunting. Theres no question about it. But we have to do it. And were increasingly looking to our vendors to come to us with transparent display, if you will, of your supply chain so that we can understand it, so that ecowith have confidence in it and really make sure that everything that comes through the front door is uncompromised throughout, whether its equipment. It could be cameras, chairs, furniture, i. T. Equipment, i could go on. We have to think more seriously and Work Together<\/a> on the supply chain because understanding it takes multiple views and multiple phases of both supply chain and on the government side too. Its knowing that youre a target. There are multiple methods that the chinese are using right now to go after our technology and intellectual property. So, cyber means, clear defense contractors. We know you are a target and we know its your unclassified information, your subs that are the target. Basic cyber hygiene, encrypt data at rest, dont connect thumb drives to Mission Systems<\/a> and then the internet. You would be surprised some of those that do that. But basic cyber hygiene. Knowing having strong Insider Threat<\/a> programs, better controlling your sensitive but unclassified material. So, theres a whole host of things that you can do. And we are in the department treating security as a missionary and no longer an a admin. For the first 25 year of my clear i had the luxury of not paying a lot to economic intelligence. For a large part we relied on large partners or niche partners to do that for us. The last three years ive spent more time on economic intelligence and understanding the connections between economics and Security Issues<\/a> and industrys ability to work through those issues is welcome. To echo a little bit on the cyber hygiene, defending and protecting your networks, but also having the same approach to counterintelligence that we are doing. We are scaling up our approach to counterintelligence due to what is being relaid to as chinas approach and other peoples approach to direct access vectors. The direct access vector to what they want is not necessarily the path theyre going to take. Chinas Global Presence<\/a> gives them a lot of opportunities. For me it is asking industry to be cognizant of your networks, people, connections, vendors all across the globe. And the last piece is our National Strategy<\/a> really depends on allies and partners. Anything industry can do to help protect and secure the networks of friends, partners, and allies because of our desire to connect to them at speed and scale with data means were going to have to rely on the security of their networks. And theres a application to u. S. National security. So, let me echo Industry Partners<\/a> a little bit and get the reaction. You guys make it so hard for us to bring you the best technology that solves your problems today. You talk about acquisition reform, talk about acquisition agility. You built all kinds of structure, universal needs statement, joint universal, all sorts of things that fix the symptoms but doesnt allow industry to bring the best ideas, the best capability, the best technology to you today. Wheres the department . Where are we in really allows industry to help us be good partners . Anybody want to jump on that grenade . Because thats what i hear from industry. You make it really, really hard to help. The first person that told me that was jake jakobi when i took over at dia. He said ive got stuff i cant share with you. Wheres the department on acquisition reform, acquisition agility . What can we do better . If i could phone a friend and have ellen up here, theyre doing a lot there. But i cant i sorry. Theres a lot of truth to that. I told them no got you questions. That may have been a got you question. No, i think theres a lot of truth to that. Me working with joe kernen who has not spent time at the edge of the spear but also spent time at industry, we know theres plenty of talent and ideas out there. Were seeing the services whether its castle run or other activities or vehicles to bring in ideas. With maven, we brought in over 40 different Industry Partners<\/a> from the bigs to some of the smaller dot com start ups. Ill say we need to do a better job practicing what we preach. But what we say agile d development, theres a ba out there for something give me something in six months, give me something in six months. Dont give me a proposal for how to do it. We put six months out there as a bogey and we sprinted and had capabilities across the spectrum of bigs to smalls actually deliver that we are able to integrate. Dont bring us proposal. Bring us capability and well build it if pr there. I was going to go with minimal viability product. You could talk about what that means. I think you just did. Dont bring me proposal. Dont bring me 18 power pooint slides. Bring me something thats usable today. Anybody else want to jump on that . I can speak to the congressional side of this. Even in the context of mars, what were finding is still in some cases a level of discomfort on the hill with all things Agile Development<\/a> because its not welldefined by definition. Particularly as theyre looking for us to justify resources and investment, theyre saying when is it going to be delivered . What are you going to be able to use it . When am i going to see something concrete . How much is it going to cost . Were saying not sure because were going through Agile Development<\/a>, and testing things out, and were going to like some and not like some and have to adjust. Some are having a hard time embracing that and supporting that. Yes, the department has work to do for sure. And we all have work to do on leveraging the flexibilities that already exist, but we also have to work with congress on the receiving end, if you will, because theyre fundamentally critical of course to us proceeding. Trey, did you want to oh, you didnt. Im very happy with the spots. You have one of the Biggest Challenges<\/a> in terms of warning in the j2, trying to get insights. And i remember many times the u. S. Forces career commander wanted 72 hours of unambiguous warning. Have you solved the warning problem yet . And if you havent, what do we need . What are the challenges, and how do we get after solving the warning problem for you . Thanks, sir. Theres a lot being written about the warning problem. I think a lot of people are citing we have a warning problem. At the same time the question is do we have a warning problem or an only nishs problem . Do we have a listening problem or a data problem . This kind of gets to a natural segue. What keeps you awake at night . Is emeril jakobi here . I dont know if you remember 25 years ago, you said i just want it you wiall. I want it all. I want all the data. And that was at that time, it seemed like a huge quest. But it was at least a goal we could set. Now im more worried about what were not going to at least even assess, what were what hits the cutting room floor. So, that really keeps me awake. On the warning problem, what hits the cutting room floor. So, we need an application. We need a series of applications. We need some additional help so that we have the certainty that at least data has gone somewhere and has been processed through ill just offer perhaps Machine Learning<\/a>, ai, to at least queue us what i was talking about before. New variables, you need to know this. You need to at least consider this. Thats where i would say thats kind of answer one on what keeps us awake. And it is directly tied to warning. The second would be also related, and that is assessing ourselves. How do we know that we are assessing ourselves . This is tied into the joint concept for intelligence operations. This is kind of the second part which is a spiral estimate of our own readiness. So, as we get into this globally integrated world and so many things could go wrong, so many warning problems could be out there, opportunity costs, et cetera. How do we know that we have all systems on go . How do we know that the federation we set up is working . How do we know weve got the right number of analysts allocated to different warning problems that might be related . So, other aits a complex answe to what seems to people to be a very easy question. Jeff. Can i had one thing to that . In my vignette for warning that was instructed mofor me, we had usks. All the warning problems that are written with precision and tracked by the most number of people to provide the most collaborative results, that is the warning problem. But, you know, quite frankly, theres three major aspects to it. One of them is warning of just internal stability for north korea. So, when we just swapped out and i say just. Its been a little bit. Usfk commanders came through the Head Quarters<\/a> in a series of office calls. My first conversation was this sir, what do you need warning of . He rattled off three things which required a major rewrite of the warning problem. To me thats always step one is understanding what do you want warning of and then designed the warning problem and being comfortable if two weeks later what i want warning of changes. I dont have any questions et why, so either were having a really great conversation and you guys dont have any conversations or we put you to sleep. But thats okay. We cant weve got to talk a little bit about cyberspace operations. U. S. Cyber command is coming up on nearly ten years now from the early days. How are we doing in terms of intel support to cyber stations . We thought our way through the right policies . Are we meeting the requirements from the joint staff . How does dia organize for support to cyberspace . Or is it just another intel thing thats plugged into the multidomain world . Jump ball. Ill take a stab. Having seen it at least from nsas perspective, i think were postured better than people think mainly because cyber is a domain that is inherently intelligence driven. People are in the domain. Intelligence analysts are in the domain when they do the collect and help an operation to occur. To think that its broken and that there is not sufficient intel support to cyber perhaps reflects some people who arent entirely familiar with what actually happens inside of an ops room. That might seem a bit harsh, but its true. Its very hard to describe just how much intelligence is going into a Cyber Operation<\/a> without it being inside the ops room. So, im actually more optimistic than most people on this issue. Okay. Anybody else . Susan, you want to talk about jwix a little bit . Whats it look like and what do you need to transform . What does the future look like . I wish i had an answer to that. What were trying to do is gauge from the Broader Community<\/a> exactly what they think they need from it. It continues to evolve. As i mentioned earlier, it started as a core ic system. It was exactly that for many years. What weve seen over the last five years plus is really an expansion of interest in jwix in the system. Theres multiple reasons for that. Its fundamentally trust and the reliability of the system and the security of the system. Its understanding that frankly thats all the information you could need would reside on that system instead of going back and forth between super net and jwix which is efficient to many users. Were trying to generate more of that conversation of if we were to create jwix today what would it look like, the ic, dod, and broader. Were looking at this is an opportunity to have exactly that conversation because there is such a demand signal. So, were trying to understand that so that as we head down our path of modernization, were addressing all of those concerns and those potential scenarios for where jwix will go. So, more to come on that conversation. No longer an intel collaboration environment. It is a command and control. Its a decision support. Its an intel environment. It is all of the above to all customers at all times. And the real question is is that the right model . And if its the right model, what does it mean for us designing the next version of jwix 4. 0 or whatever the heck it is. Its certainly evolved from heres a Intel Platform<\/a> at the highest level to every combatant command, j3, j5, azure jwix box. Whats the partner environment that allows us to collaborate in that space . There are lots of different versions out there, but something we really to think our way through. All right. Jeff, youve been did you want to jeff, youve been in jake now for how long . Been where . Where are you now . I work for mr. Purnen at usdi. Not the jake. I thought you were going ointo the jake. Okay, maybe oops. Maybe i shouldnt announce that. Thats another air force general. Maybe i should get to know the air force. One of the great challenges we have today is awful lot of data being collected on all of us. And what do we do to protect our data internal to your organizations, data thats collected on us . Are we doing anything to make sure that that environment is clean for our intelligence professionals . And what can industry help us to do to protect our data if anything . Jump ball. I guess, you know, theres at one level theres the we clearly have laws, policies, regulations. Theres a lot of dod directive and instruction on how we protect information. But then theres the actual mechanics of it and the technology of heck, weve got the Background Investigation<\/a> mission coming to dod in less than a month now. And as we look at rebuilding that i. T. Capability, you know, its ensuring that it is all of our, everyone that has a clearance or credential, that your information is protected. So, its building all of those Cyber Security<\/a> elements in up front into the system. So, i think theres a technology piece to it as well that well continue to need help on. Heres the thing that i want Industry Partners<\/a> to think about. All of our datas available out there to any of our adversaries. And even the data that we try to protect is available to our adversaries. We have closed circuit tvs and cameras in every city thats capturing biometric data. What does that mean for us not only as a society but for intelligence professionals . How do we protect that day . How do we make sure your adversaries arent able to use that data . So, how industries are able to think through biometrics, closed circuit tv, all the day that thats out there on the dark web that exposes all of us, but more importantly our sensitive collectors . How can industry help us to solve that problem. Thats where i want to go with that question. You think about the super squirrely stuff we do, our human intelligence, counterintelligence. The last 15 plus years of ct has been focused on vetting taliban and whatnot in afghanistan. But when you have a sophisticated russia or china, those skills have atrophied over the last decade and a half. So, were working on rebuilding it. Youre rebuilding in this modern Technology Environment<\/a> where theres constant surveillance, smart cities. Everything out there on the internet that our agencies are having to think about that, human ci, cover, all those aspects that are core intelligence missions. All right. Dodc commercial satellites as alternative to National Technical<\/a> needs. Ill say as a compliment to National Technical<\/a> needs youre still going to have your need out there for some pretty exquisite High Resolution<\/a> capabilities and other features that those satellites have, you know, maybe some additional protective measures given where the threat has gone in space that you are willing to pay a premium on. At the same point in time, god, is it an exciting time to be in commercial space right now. I visited one place a couple of months ago where theyre fine tuning their production line to pump out six, seven satellites a day. Its unfathomable for someone six or seven years. There are really exciting things there. We absolutely from nro to others have to take advantage of that. The other piece of it where industry can help us quite a bit is not just on the sensing side but on the tped side. You go into a ground station today, it is manual, labor intensive. Youve got people moving around bars on computer screens. When you get into the constellations of the size were talking about, you cant have a person in the loop doing that manually. So, all the automating tasking, all the collection optimization, the processing side of it, moving algorithms and processing even upstream further, freeing up your analyst to do other things, there is a whole manual labor intensive linear set of processes out there that we must do better. And if were going to be dynamic as we were talking about earlier and much more responsive to the threat environment were seeing visavis china russia. Yes, go ahead . I would offer as a former j2 for u. S. , a place we have partners who would really appreciate that commercial imagery has a perfect application there as well. Its for partnering as we were talking about. It provides them at least with an avenue. I could add one or two vignettes to that as former j2. The commercial imagery weve seen over the last few years have been crucial and helps get the most out of national architecture. For example, indo pay com was a lot of open water. How do you track open ocean areas . How do you track north korean ship to ship transfers of elicit oil . A lot of times that was only a certain period of density with National Resolution<\/a> and being able to stitch those together cohesively in a way that gave me the best picture i had and could provide my boss was always a combination of the various pieces together. So, i think thats really the future. How do we stitch that together and then back to the point on the ability to extract information out of commercial imagery and making that readily available. Trey and i just happened to be having a conversation earlier today about synthesis. Theres a lot of data. How do we take all of that down to those two or three key take aways that we need to make decisions in a highspeed priority environment . And the ability to extract data out of commercial imagery is an important business line to continue to pursue. So, this one came from the audience, but i was wondering about this earlier. Ill talk about Machine Learning<\/a>, talk about Artificial Intelligence<\/a>, talk about the technologies coming into the work force. Is our Work Force Ready<\/a> for this . What are we doing to make sure work force culturally ready for this influx of technology . Or is it the same work force . It might be the same work force, theyll adapt over time. Any thoughts on what are we doing to prepare the work force . From dias perfective, its a little bit of both. Work force adapt already, are hungry for it, are eager to continue to evolve their own capabilities and their habits frankly on how they leverage technology. But that said, theres no question that some of its going to have to be trained. Some of its going to have to be hired to some extent. And what were trying to do is really hone in on what does that look like . What skills do we have to teach . What skills do we have to seek out and recruit . And defining that is still part of the puzzle, if you will, that were trying to piece together on it. But the work force in many respects, we have such a great work force that theyre very adaptable. They like experimenting. Theyre innately curious. You put a new piece of technology in front of them and they will play with it and figure out what it can do for them. Theyll take full advantage of it. Its a question of how do we leverage that and encourage and that and develop that where rounding it out where we have the gaps with the hiring and training. I would agree with that. We have analysts obviously who are sourced by dia. We are dia. And especially younger crowd are looking for advantages all the time. Theyre always looking for an advantage. So, a new application issing g to be welcome. I dont think were going to run into a situation where analysts are going to be in competition with Machine Learning<\/a> environment. Theyre going to find it complementary. Theyre not going to find it a subsubstitute. Theyre going to find it an addendum, something that queues them tie better product. How do we train them . The training that we do today is probably not the same sort of training and preparation we need for the future analysts, for the future work force in this environment . Is there something we would like industry to think through in term of how we train to be successful in the next era . I want you all thinking about virtual training. I want you all thinking about immersive increasingly complex training. I want to think about how painful it would be to have an instructor standing on the podium lecturing as we prepare our work force. Whats the different training model . Is there a different training model . I can envision a situation where we would put emphasis on certification to use the tool so that the analyst knows the left right limits of the product and of the queuing coming out of the tool and we probably need to ensure that theyre witting to knowing the tool is probably off at this juncture. This is based on what could be a bad variable. I need to regroup and try again. We went through this actually a long time ago with maven and everything thats happening. We actually looked at the automation of point dropping and the targeting community. And there are some tools that made things very quick, but they also cut a few corners in the interest of speed. So, as we thought about it, we said we want this tool, but at the same time, we want to know where it potentially is dangerous to precision and to accuracy. And that was the basis of certification for using the tool. Tool is actually used. Its not a substitute for the good ole fashioned way of dropping points. It just happens to complement the process. I could envision analytically a very similar environment. Just know what your left right limits are in terms of tolerances so you can queue to yourself and to your chain of command that this was based on Machine Learning<\/a>. We might need to take another round. It also goes back to just we need to preserve the hard Critical Thinking<\/a> skills of our analysts, especially with all these different data sources that are even more readily available at their fingertip. Whether it be the Machine Learning<\/a> tools, traditional imagery, or signal intelligence. Even i think publicly available information, we are using that so much more, but you have to be able to discern how reliable, how credible is this, and what kind of decisions are being made off of it. Theres an evolution of the trade craft and those Critical Thinking<\/a> skills that have to evolve with the technology and all the different data were getting our hands on. Lots of the services are talking about multidomain operations. You know, when i started this business, the army and the air force did their thing and the navy and marine corps did their thing. Then we got to joint out to grenada and talking about land battle. Now were talking about multidomain. What does that mean for the Intelligence Community<\/a> . For the j2 and the joint staff, you have operations in a globally integrated world. What are the challenges of the intel support to multidomain operations in a globally integrated environment . Sir, i think i can go back to how to assess the opportunity risk as were beginning just a bit too fixated on a regional problem. That is not an inherit part of our train craft. Lets just imagine we have training we have decision tools for something as simple as moving from point a to point b in our smartphones, we use either google maps, waze, Something Like<\/a> that to help us assess how quickly, whats the best way to move from point a to point b. Youre going to use different choke points. Just image they are different variables. Everybodys done it in here. You just use testing the monte carlo to make sure its correct. Now imagine you have an armada of cars trying to do an objective as well. But there are others who are having armada of cars and they actually want to confound your solution. Imagine all the permutations of that. That starts to get very complex when youre thinking about the monte carlos for opportunity costs and how an adversary might take advantage of your dilemma in a particular place. How does an analyst efficiently succinctly address that . That is not something that we necessarily train to. I would add theres a data side on the back end of this. Multidomain would require one service to sense, another service to shoot, and perhaps a Third Service<\/a> sink a ship. How do we all have that same picture that we can have common understanding and that requires interoperability and data standard that we have yet to achieve but continue to work on . And then there is the data integrity of the data that flows across there to get after treys point, how do you ensure that nobodys putting false data in there so if youre doing long range of horizon fires between a shooter who cant see the target and the center that youre not causing fires to go astray or on your own folks. Theres a tech side of multidomain operations i think that underpins it. Once we work through that piece, then it becomes the ttps and the trust and confidence in how that would work in a Global Integrated<\/a> environment. I dont want to speak for admiral coaler and the navy because i think these things are still going on. But let me talk as a naval officer. I think the jurys still out as to if were talking about the domain of space, talking about the domain of cyberspace and how specialized this particular these domains are, we have to ask ourselves whether generalization as were rearing especially officers is the right path or whether we might need to think very seriously about specialization. I was having this conversation with admiral jakobi not long ago. Right now we tend to seek generalists and might need to adjust that in cyberspace going back to your specialized craft. Might need to keep people at keyboard for a long time. As opposed to back and forth between some of the domains we have within our services. I think the air force is already moving in this direction. Suzanne, you were going to comment . So, mars, the vision more mars, is to enable multidomain operations as well. Fundamentally one of the key efforts under mars is to understand and try to pull together in some form or fashion various capabilities of the individual services were going to be using, leveraging, how they bring them together with common data and common access to that data and feeding it back and forth in and out of mars as needed during operation, too. Thats a fundamental precept of mars looking forward is how exactly to enable that feature. Yeah, theres a good amount of plumbing we still need to do in our community. Ill use dcgs as an example where, yes, you can share it was supposed to be the Common Ground<\/a> system and weve seen each service has developed its own kind of bespoke capability, so although you can share products the raw data isnt necessarily interoperable. Interoperability, data standards, formats and architectures talked about earlier. Theres a trust piece, you have to trust that someone else is going to provide data, you can do something with it or act on somebody elses data. The Missile Defense<\/a> community, theyve had to work through that in the last ten years or so. I think we need to apply some of that learning to other areas as we think through multidomain. Talk a little bit about ocent. Creating an opensource center. Some thoughts about how that might work. Implications of if you do this, youre going to bump into u. S. Persons data. We thought our way through the policy. Just spend some time expanding on open source center. Sure. Come october is when we kind of open the doors, so to speak, on a more formal center that weve had ever in the past and its going to grow over time and evolve over time so part is a structural change for us, organizing the activities more specifically to include dedicating people into respective centers or commands, who really will be kind of the hub of the ocent activity in that location, but then as you indicate, part of it is what is the trade craft behind it . What are the rules behind it . Again, i think because so many of our analysts and pocketers have been kind of sort of doing it on their own for many years, you know, the imperative is clear we have to bring some discipline to this particularly when it comes to u. S. Persons to make sure everybody is doing it appropriately and accurately and oversight perspective that we can stand by it. Its a significant change for a number of reasons for us. But its going to be a, you know, an evolving effort because were not going to wait until we have all the answers figured out before we embark on this. Were going to jump right in and kind of fashion it as with go, but its been years in the making. The good news is weve finally figured out this is fundamentally something that is, in fact, structural, there is a dedicated career for it for many of our folks, theres enough of a career there and enough of a discipline there that we can call it as such and manage it as such. So i think what were trying to figure out, though, too, is what does the enterprise do . Were focused first and foremost on dia. Clearly the enterprise as a whole, whether its the services, the broader commands, what have you, theyre going to have a role as wiell and thats going to be kind of the next step were going to have to define is how do we leverage the enterprise when it comes to ocent, figure out who really can do what, who brings a comparative to the problem set and knit it together. Its going to be a continued effort even after we open the center. Could i add to that . I think one of the grate applications of Machine Learning<\/a> and a. I. Is in this realm, not necessarily finding medium in these large volumes of data, its doing at butribution of th data, can we use a. I. Machine learning to help discern is the person behind that particular bot or eapost or whatever tied u. S. Persons. I think its great opportunity there for a. Ii. , Machine Learning<\/a>. I agree. Cant say enough about ocent as actually form of an Early Warning<\/a> especially in theaters where we just dont have sufficient collection. The speed is unmatched. And so you really need that vetting behind that particular one liner to find out if this is an Early Warning<\/a> we need to pursue or Early Warning<\/a> we need to ignore. All right. In the Intelligence Community<\/a>s assessment, what extent will china dominate 5g communications, how prepared is the u. S. Government to protect both government and commercial 5g networks from foreign threats . Can you jump on that one . So if i can take it, i dont know if i can speak for the broader Intelligence Community<\/a>, i would say they its one of their national priorities. They have put a lot of effort and resource behind wanting to dominate in the 5g arena. Id say technologically, i dont think that theyre there yet so its not a foregone conclusion. We will continue to have to stay after it. But this is an area where we in the department are spending a good amount of time on and working with the Intelligence Community<\/a> as well. First off, just to make sure that folks understand the security risks of it, whether its our and our foreign partners, whether its our european our middle east, other asian partners, is there is a clear it may be a great package deal today, financing tied up with a bow, but you need to look long term at the security risks and the onus i think is on us in the department to also articulate what the military and security implications are of relying on a chinese or huaweibuilt 5g telecommunications architecture. For starters, you have a china National Intelligence<\/a> law that mandates that that companies and individuals, you know, compel them to cooperate with the chinese government, but on the military impact side, whether its intelligence sharing or mobility, there are tremendous amount of military areas that would be affected when we do not have trusted telecommunications capabilities with our close partners. And its been a challenge working this with our allies and partners for them to see beyond some of the nearterm economic benefits but to look at those longerterm security risks and getting the intel and defense, National Security<\/a> folks, then talk to the Commerce Business<\/a> community and hop those stovepipes. Were working in the department with a research and Engineering Group<\/a> so dr. Griffin and dr. Porter are leading an effort to create an integration test bed so whether youre u. S. Or other companies, i would note, there are other companies out there that are probably leading beyond the the u. S. Does not have an end end solution. Theyre working on developing an integrated test bed so that companies can come and test out and evolve their technology and work the integration pieces of it so there are viable alternatives to a chinese 5g system. Okay. Well start on your end, trey. I think you touched on this a little bit already. What keeps you up at night . Anything else . Im looking for the black swans. Looking for the things we go, its russia, china, iran, north korea, oops, it was yes, zblir whsir. What keeps you im going be honest with you, very few enemies or adversaries keep me awake. Its more the knowledge of ourselves and readiness of our own systems ensuring that were not missing something. Missing the big story, putting the pieces together, the things weve already talked about today. Thats what keeps me awake. Yeah . I would absolutely say the same thing. Theres no adds vversary or potential adversary that keeps me up at night. It is about our ability to sustain over time a longterm disciplined approach for the various problem sets that are out there. How do we address the urgent needs and the important needs concurrently and can we maintain that . So thats probably what keeps me up at night. Your black swan question is a little bit different in my mind. For me, that is about an area where theres potential for escalation that we have not been through that escalation cycle previously and know how to handle. So India Pakistan<\/a> border, india china border, theyve worked through those issues methodically over time. Theres historical precedent in some of thaez arose areas but t continue to change and those are the ones that i would say are worth watching to ensure we understand where were going and are providing best advice, assistance, to friends, allies, around the globe to work through those issues. Yeah . So i think for me, its the risk that we assume every time we have to make a tradeoff decision. So clearly, you know, we have many more demands than we can ever meet by way of requirements. And our resources just wont keep up. Regardless. So we are almost on a dale lay b basis having to make choices. Obviously, theres risk in every choice that we make and we con communicate that risk all we want, but just worry that somethings going to result as a result of our decisions and that risk is either not going to be appreciated or were not going to be able to respond. We have a Tremendous Community<\/a> out there across defense and National Intelligence<\/a>, folks that are working 24 7, 365 days a year, so i dont know that theres anything specifically that keeps me up at night. I actually would echo what trey was saying. I remember he and i just thinking over the last couple of days, he and i were on a phone call last friday and we were asking ourselves, hey, have we do we have the policy in place so that the folks that need to take action, you know, whether over the weekend or on a holiday, you know, that they have the authorities, they have the policy, they have the guidance, to do what they need to do. And its making sure weve thought through those and that we, you know, im in policy up at osd, making sure we provided that frame and guidance to them so they can go off and do what they do best. Okay. Im coming down the line now. Give you one last time to talk to industry. What are your top one, two, three, priorities, what do you think in this you could do to help . Start with kari. Helping us modernize our very manual laborintensive lib ynea processes. The more i see, the more i uncover in this community, there are a lot of them we fine tune and are bespoke that we need help on, so that id say, helping us evolve in areas like a. I. , maven, mars, getting those scaled, getting them out to the field, and then i would be remiss if i also didnt talk the security pieces. You know, with the china and a russia who are intent on getting after our technology and our intellectual property and our people, we have to protect that. We have to make sure that we have a trusted workforce and well need industrys help in all those areas. So, ill emphasize pie chain one more time, but then, obviously, with mars, and mars is just the best example to date we have of working with industry and asking industry to challenge our assumptions on what we think we need to help us really think through and think a little more creativity about what we need. And that obviously takes some understanding and constant engagement to live in our shoes a little bit so you can, in fact, do that. I do worry ae all kind of fall into that trap ofand asking y you to deliver it. We have to flip that and you have to challenge us on that a little bit more. Data interoperability and standar standards, propriety data standards. Were past that and moving past that. The Business Model<\/a> of the future is about integrating and understanding data. And the more we partner with industry, and then collaborative development. If we ever do solve the Agile Acquisition<\/a> kinds of things, it means partnering with industry from the very beginning of what are we trying to do, how do we do it, how do we fail together, then how do we deliver some subset of what we started . Theres a Business Model<\/a> somewhere in there, industry does it well. Theres a path for the government in there and partnering with us to help design that and making congress comfortable with that sort of strategy. Were the functional managers for three disciplines. Warning, collection management, and targeting. We havent talked too much about targeting, but im going to offer three things in that order. In warning, just helping us not sacrifice accuracy and thoroughness, completeness, for speed. And collection management, we need to help we need some help automating the process, automation for collection management is dated. Then in targeting, we always need help. This will be the case from now until eternity, just helping distinguish enemy from nonenemy. Its one of the hardest things we do in the business. Okay. Were going to stop there. I ask you to give the panel a round of applause for spending some time with us. [ applause ] hopefully we didnt get too many jump calls and thank you, all, very much, and weeknights this week, were featuring American History<\/a> tv programs as a preview of whats available every weekend on cspan3. Tonight, Garry Adelman<\/a> of the American Battlefield<\/a> trust covers the whole civil war in 56 minutes. This talk kicks off a night of programs from a Gettysburg Heritage Center<\/a> symposium. You can see it tonight starting at 8 00 eastern here on cspan3 and enjoy American History<\/a> tv this week and every weekend on cspan3. In his first public remarks since leaving the trump administration, former National Security<\/a> adviser john bolton talked about north korea. He said military force needs to be on the table. One, is the possibility, limited though it may be, of regime change in north korea. Second, we should look at and discuss with china, and we should have done it long ago, aiming toward the reunification of the peninsula under a freely elected government like that in south korea. And third, if you believe, and you may not, that it is unacceptable for north korea to have Nuclear Weapons<\/a>, at some point, military force has to be an option. Now, this is, obviously, the most controversial subject and many people say its just unimaginable. Unimaginable that you would use military force. So let me quote to you the words of general joe dunford, chairman of the joint chiefs of staff, on his last day, i might say, as chairman. Hes done an outstanding job. He said this to the Aspen Institute<\/a> seminar in the summer of 2018. On this question of whats unimaginable. General dunford said, but as ive told my counterparts, both friend and foe, it is not unimaginable to have military options to respond to north kor Koreas Nuclear<\/a> capability. What is unimaginable to me is allowing the capability to allow Nuclear Weapons<\/a> to land in denver, colorado. My job will be to develop military options to make sure that doesnt happen. I think general dunford was completely correct. You can see john boltons entire speech followed by q a at the center for strategic and International Studies<\/a> in washington, d. C. Well have it for you tonight starting at 8 00 eastern on cspan. The u. S. Intelligence community is looking into how a space force could change intelligence gathering. A discussion now on emerging threats to National Security<\/a> and what that will mean for the Intelligence Agency<\/a>s space policy. The Armed Forces Communications<\/a> and Electronics Association<\/a> and the intelligence and National Security<\/a> alliance are hosts of this summit. Im tisch long, im chairman of the board of insa. Im very honored to be moderating this very distinguished panel here this morning. And i think were going to have some fun. At least thats what i told them backstage. Okay. On the pan","publisher":{"@type":"Organization","name":"archive.org","logo":{"@type":"ImageObject","width":"800","height":"600","url":"\/\/ia601005.us.archive.org\/32\/items\/CSPAN3_20190930_175700_Current_Pentagon_Officials_Discuss_Intelligence__National_Security\/CSPAN3_20190930_175700_Current_Pentagon_Officials_Discuss_Intelligence__National_Security.thumbs\/CSPAN3_20190930_175700_Current_Pentagon_Officials_Discuss_Intelligence__National_Security_000001.jpg"}},"autauthor":{"@type":"Organization"},"author":{"sameAs":"archive.org","name":"archive.org"}}],"coverageEndTime":"20240716T12:35:10+00:00"}