The Los Angeles Police department to court forcing it to release the details of its Predictive Policing Program theres 2 layers to predictive policing one is a community and a location based where algorithms are used and the Company Principal has developed that algorithm which was owned by Jeffrey Brown thing and was a professor of anthropology and has a long history himself how this thing was created on the on the feeds of afghanistan and iraq directly coming from the border from the war zones and the other piece is operational laser which is a person in a location based predictable policing program laser stands for los angeles strategic extraction and Restoration Program and the reason why its called laser is that the creators of lasers said that we wanted to go into the community with a medical type precision and extract teamers out of the Community Like lead from a position thats where they came up with a half and so they came over the acronym as people are tumors the exact fact i think is not really. What credible and laser claim to offer is a one stop crime prediction shop the pitch is to tell police not just where crime will occur but also who might commit crimes in the future. The l. A. P. D. Was using these technologies to decide where to deploy their police patrols. Focusing resources on socalled crime hotspots like by these. So this is all the hot spots for a particular time period hot spots are created by the algorithm the prep for longer where they use the information long term crime history or short term crime history and then they create these 505500 square foot hotspots on what basis how are they deciding this so to put it very bluntly theres a lot of pseudo science and now its being presented as these computers are really snootful and they would predict when a crime may happen. But predictive policing doesnt just flag up a place with laser it also sticks to a person the l. A. P. D. Maintain something called a chronic offenders bulletin these bulletins are undisclosed reports on socalled persons of interest people the Police Believe to be likely to break the law. This risk is calculated using a points based formula based on data from Police Records field interviews and arrest reports this is pulled together and scored by algorithmic software created by the defense contractor pal and here a company with close ties to the u. S. Military. So how do you get yourself on to the laser system so these are the things that identified these risks so if youre stopped and a field interview cards filled one point so if you know there is it or if the police stop stop youve got a point one point immediately youre going to point this individual was stopped the same day 3 times so the treat for 3 points right there if there had been a previous arrest with a gun 5 forms if you had any Violent Crime 500 parole and probation is 54 and and identified as again as gang affiliated 5 point. When it comes to the chronic offenders bulletin points can mean prison but its not just about locking people up for hemant the data suggests increased Police Attention at the borders of a historically deprived area called skid row which helps keep the poor contained from the more affluent neighborhoods nearby. So this is like a beachhead so think of the defense of financial district yet from poor people you know when we talk about hot spots you know you will see the dirty divide how the proximity of extreme growth and extreme poverty coexist right here about 2 blocks from. Absolutely. He was going oh i am doing good to me and cory general. Secretary of. The building right there. I meet Steve Richardson who goes by his street name general doe gun hes a former prisoner and skid row resident who now works with the coalition campaigning for greater protection for the local community. Say you guys have been doing work on this predictive policing stuff right is what does that look like out here on the street to people who live here so predictive policing rolls out and a lot of weight because i mean skid row is ground 00 all experiments that have been you know busy so this is poor folks because so all a little programs l. A. P. D. Spy programs everything that they come out with is 1st tested right here they they 1st last to say for seriousness right here was growth 110. 00 extra police to skid row making it the most oldies community not only in america but 2nd in the world to baghdad got all kinds of patrols on skid row so we got the cops on motorcycles we got regular cars we got. We got detail cops theres all polies in like a 15 block area what are cops on horses right smack in the middle of the house you know they have no things continue to come out here from a lot. About 80 percent of people here are black right about any sins people suffer from something. A disability may be physical you know semi or mental and all of us is full of. The most arrested person on skid row was a woman 8 and moody sousa arrested under 80808 times for violating 4118 right 41 a day is up in this book called to say you can sit sleep a lie on public sidewalk so our only crime was she was homeless and have anywhere to go and was forced to sleep in public space she got arrested 118. 00 times for being 100. A year just for just being in public space and it was all over you know based on a lot of predictive stuff like that and the point you you doeg on and you have and are making is that this is a practice that goes way back right over policing in this Community Goes back decades and then that information from that then gets fed into the computer and the computer turns around and says well go back and do some more of the same thing right now and the computer before the information gets in the algorithm is designed for policing so the algorithm would create outcomes that an agency wants to achieve and this is really the key point and the outcome that the agency wants to achieve in this community is cleansing and damage when. We walk further along the tense begin to thin out as to the local residents gathered on the sidewalk were its obvious were approaching the outer limits of skid row the hotspot boundary hamad had pointed out earlier. This is like a fun the still form of host of hotspots that a person from skid row would be walking into and this is where you will have more policing waving for people who are for him than waiting for people to give them tickets waiting for people to throw them against the wall right. For people to intimidate and harass and demand to believe the neighborhood. But few weeks after we left skid row the l. A. P. D. Announced that it was canceling the Laser Program the pushback worked police admitted the data was inconsistent but the l. A. P. D. Says the predictive policing tool pred pull is still in operation. So lets think about the incentive structures with some of the predictive policing tools that weve been talking about what does it say about the incentives and the problems were going to have with these tools that youve got counterinsurgency software then essentially used for Law Enforcement purposes i hate to have such a sinister. Interpretation but i think its about opening up new markets to sell this software to 0 and Law Enforcement in the last is you know been a great market for lots of military technology is quite frankly i think theres actually the opposite incentive to get it they have the incentive to get it all Predictive Policing Software has an incentive to make the sale with police so their incentive is to is to make predictions that are as close as possible to what the police already believe is correct so given that its really hard to know. If ai has been tried on representative data or or not if we have real reason to suspect for example that there might be bias than isnt there a question about whether the system should be used at all well i think thats the fundamental issue is that were seeing the deployment of all kinds of automated decisionmaking systems or ai over we want to kind of characterize it and we dont know the effects until after the fact after the damage has been done is primarily how were learning quite frankly about what doesnt work and i think it goes far beyond bias i mean were talking about aggregating data about us Building Data profiles that for close certain types of opportunities to us and whats more dangerous i think in the digital age about this is that you know in the 1950 s. If you tried to get a mortgage you were you were black and try to get a mortgage at a bank and you were discriminated against you were very clear about what was happening that discrimination was not opaque and when it moves into a Software Modeling system what instead you have is a banker whos like you know im sorry dr noble you just cant have it and i dont really know why and so that lack of transparency is one of the things that i think were kind of trying to contend with here and this just becomes a wholly normalized process we dont understand or with you know the the models for actuarial science for determining whether youre going to pay more insurance for example because you live in a particular zip code doesnt even account for these histories of racial segregation housing covenants real estate covenants so just because we look at the zip code that doesnt tell us about this long history of discrimination that has sequestered people into particulars of codes those are the kinds of things that i feel like over time become harder and harder to see i think one of the things that i find. Worrisome is that we talk about data being collected for these kinds of systems and for the most part they just collect of some completely different purpose it just happens to be there in policing data is created by the police doing what they do theyre driving around theyre stopping people there occasionally arresting people and so forth that data gets produced and then is used in a predictive policing model its not collected for the print predictive policing model thats a 2nd order effect thats used because the data is already there and it turns out that it is a terrible way to predict where future crime will be because what police do is not collect a random sample of all crime they collect the data they can see this is true in most of the places where people are applying i think it is useful to detect where bias is happening and simulation can be important that i think thats true however it doesnt necessarily allow people to have again this conversation that i have been discriminated against its just sort of leaving the expert analysis to make that discovery when in fact there are a whole bunch of people that wanted to be homeowners or you know wanted to move house and they dont really understand why these decisions are happening so as a Data Scientist whats your take on this how do we build a kind of test for when its appropriate at all to use Machine Learning and when its not the question should be who bears the cost when a system is wrong so if we unpack a particular system and we say ok were building a Machine Learning system to serve ads and the ad that were serving oh this customers searching for sneakers but we served or boots at. Oh dear we were wrong there no one cares thats a meaningless meaningless problem the consumer could care less we get along ads all the time were trained to ignore them lets compare that to a system which makes prediction about whether or not someone should get credit. In a credit based system if were wrong the consumer who should have gotten credit doesnt get it or the consumer who should not have gotten credit does get it in both cases and in particular in the case where someone who should have gotten credit does not get it that consumer bears the cost of the air she doesnt get whatever it was that she needed the credit for to buy a house or a car or Something Else the company that failed to offer the loan may bear a small cost but there are a lot of customers so they dont really bear much of a cost and so when the customer bears the harm. We can predict that the harms will be greater because the people deploying a systems a little incentive to get it right. We know that if people of color are over Police Report people are over policed and over arrested they are also likely to be over sentenced. Machine learning isnt just used to predict crime its also used to decide whether a person should be given bail or how long a sentence a prisoner serves. Criminal courts in the state of florida and use a predictive Sentencing Program called the correctional offender management profiling for alternative sanctions compass. In 2016 journalists at the us news outlet pro publica investigated compass and discovered an apparent racial bias at the heart of its algorithm. Investigative report and one of the things that they found in their hand a review of all of their records was that africanamericans were twice as likely to be predicted to commit future crime i found it incredibly interesting for example the story of died one of the reporters told that there was a black woman a young black woman who had taken a bike in one of her neighbors front yards and kind of ridden it around and the person here on the bike said bring that bike back and so she did it but a neighbor called the police on her and she spent 10 days in show and the Compass Software gave her a score of 8 out of 10 that she was likely to commit a crime again and that and they looked. White man who had a history of Violent Crime of history of being in a. Now out of jail the software gave him a 3 year so he was more likely to be a waste. Once again the bias in society was revealing itself in the machine. The. Journey to work can be a challenge on its own. But for some peruvian villagers traversing one of the worlds most dangerous roads is a risk that comes with the job. We follow the journey of these people as they get there to survive. Risking it all. On aljazeera. We have a news Gathering Team here and there is a 2nd term on there all over the world and they do a fantastic job when information is coming in very quickly all of the ones youve got to be able to react to all of the changes and aljazeera we adapt to that. My job is is to break it all down and we held the view i understand and make sense of it. Germanys birth varian helps where stunning scenery is playing host to europes latest arrivals. Separate in origin. They share a common roof and together dream of a german future. Welcome to german cafe vald loved a witness documentary on aljazeera. He said ill be here in doha with your top stories on aljazeera iran has rejected u. S. Claims that it was behind 2 tanker explosions in the gulf of oman on thursday the u. S. Released video to back up its claims but germany said it was inconclusive speaking on fox news the us President Donald Trump called iran a quote nation of terra were being very tough when sanctions. When i came into office they were a absolute terror a nation of terror and they gave changed a lot since ive been president i can tell you they were unstoppable and now were in deep deep trouble and theyve been told in very strong terms and we want to get them back to the table if they want to go back im ready when they are so d. C. Media is reporting it strikes against yemeni targets by the Saudi Led Coalition according to the reports the strikes hit you see military targets and air Defense Systems in the capital sanaa earlier a military spokesman for yemens hoofy rebel group warned people to stay away from airports in saudi arabia and the u. A. E. The rebels have targeted saudi arabias airport twice this week Officials Say the 4 oil fridays attack by intercepting drove into the airport near the yemeni border. The World Health Organization has stopped short of calling the spread of ebola an International Emergency more than 1400 people have died of the virus in the 2 yasi since august there are fears it could spread to uganda after 2 people died there this week. The u. N. Security council has held a meeting on its peacekeeping force in the darfur region of sudan the un confirmed the killing of 17 people in the burning of more than 100 houses there earlier this week the u. K. Says the Un African Union mission in darfur must stay in the region. Parts of brazil have come to a standstill during a 24 hour nationwide strike against proposed Pension Reforms if approved the minimum retirement age would be raised and workers contributions increased. The last 5 suspects wanted in connection with the Easter Sunday bomb attacks and in custody for lankan nationals were extradited from saudi arabia on friday Police Say One of the suspects helped lead the attacks which killed more than 250 people in a pull back to the big picture the news comes after that. The risks of bias baked into Machine Learning arent just confined to law and order. Upon release prisoners must reintegrate into a world that is increasingly automated. Today for them as for you and me opaque computerized systems will help decide their access to state welfare to private finance and to housing take Credit Scores these are shorthand for a persons financial trustworthiness in many ways Credit Scores are the gatekeepers to opportunity and increasingly theyre produced by algorithms fed on data blind to context and history. If that Credit Report comes back with a low score that means this individual is supposedly a high risk so you begin to sort of just go around in a circle. Low credit score criminal background cant get housing because you dont have housing you