Point. As i say, brian strong, who is the director of the Capital Planning committee and the citys chief resilience officer is a good resource. Hes sort of i dont want to say a toll collector but kind of organizer for a lot of the discussions. I think that would be helpful. And he will be here in march. We can bring it up at that point as well. Would you be up for writing a memo . Maybe the Controllers Office can help draft this. I guess do other members feel strongly that a memo sent by this committee to the Capital Planning committee to express our concerns specific to this bond and how the broad nature of the bond has ended with possible problematic ways for us as we oversee the spending of the bond. Would the controls office help us draft i think what we would like to do is have a memo from this committee to the Capital Planning committee to share with them the problems that we are encountering as a result of the broad structuring of the bond. Youre welcome to send a memo if you like. Im listening to your conversation and clearly we need to do a better job talking to you about the problematic design of this bond and answering these questions. I can rely the conversation youve had here to the Capital Planning committee, to brian and his staff and im looking at your march calendar, im not sure which item he would be reporting under . So city capital plan presentation is going to move to march 26th. Okay. So i can ask brian to address some of the questions specifically. Im not trying to stop you from writing a memo but i could relay the conversation and work with him for his presentation to address it. Timing wise, i wasnt aware they were presenting. If you would convey the individual collective concerns of this committee to brian and ask him to specifically address this particular point at the next meeting. Im happy to. In addition to that i want to second what youre saying, i would only add without missing any other bonds, this is less of a general issue that we have come across of language in bonds being so broad that the public has an expectation that doesnt get fulfilled in the implementation of the bond. It would help us meet that desire if we had clear understanding of what was going to be accomplished with the bond. The other issue the prebond planning work. Not just the seismic stuff but some soil stuff and other stuff. And im just wondering who owns the content of the prebond planning and can we suggest a check list . You can definitely suggest a check list. Obviously part of your charge is produce best practices. General matter, here are things you need to look at. You can do that. In terms of i think the question you were asking, who owns the prebond forecast and reports is that kind of when we say we do prebond planning. What do we mean by that . Can it include seismic, soil and some of the other so, again, a good historical example again i think that better seismic and soil testing work was done in advance of the sfgh bond than prior large facilities and its one of the things that contributed to keeping the cost of the facility rightsized. By the time we went to the ballot, we knew better what the project cost would be and it stayed relatively within that. Theres allocation of general fund capital in the budget every year. Some portion is spent for Testing Programs for future likely bond programs appearing in outyears of the city plan so by the time the bonds are coming to be sized, we have spent money on the testing and some of that can be repaid back to the citys general fund capital pot when we issue the bond, but that is sort of the process that is followed. And again, its partly to the credit of this committees oversight and Capital PlanningCommittee Process that thats done. And our bond sizing has improved. Im just saying lets continue to set the bar a little higher and say the prebond stuff probably happened years and years ago and maybe no one was thinking about soil then and learn from our mistakes and say next time i think we can learn from our wins. The General Hospital gives a lot of credit for prebond in keeping the project on budget and scope and that was 2008. This is a bond issue in 2016 and i think we spent over a million and a half dollars on prebond work but failed to do the seismic or soil in some cases. We dont know what were building anyway. When the bonds were put to the voters, there was a bond report that went into some specificity. Because that wasnt in the actual bond document approved by the voters, youre not held to that. But there was and it leads to voter expectations. Ill relay this discussion to brian and ask him to comment on the issues hopefully in an organized way when he presents the capital plan. Thank you. Any Public Comment on the presentation . Good morning. I have two comments. There are funds set aside for a hospital audit, will there be a comprehensive outside audit of the construction project, the 900 million size of the project merits a comprehensive audit and can it be seen on the future agenda with the project closing report requiring the final closing report is a great step forward and will that final report be posted on the csa web site. Regarding additional bond controls that bring together seismic and actual spending, is there a prebond check list and does the check list include a preliminary seismic assessment. Also would it make sense for the bond sponsor to present the bond check list in actual prebond spending compared to budget to cgoboc prior to moving forward and will allow them to address problems as they arise. It would force the issue of what individual projects in the scope of the work and address concern of the kitchen sink aspect of the bond. A priority of projects in the prebond checklist would bring transparency to the projects that get funded. Thank you. Any additional Public Comment . Next item. Item five presentation from the city Service Auditor regarding the csa mid year report and possible action by the committee in response to such presentation. Good morning. Peg stephenson for the Controllers Office. We are just past the half way mark of the fiscal year. This is the item where we give you status report and update on our work in the City Services auditor. You have a slide deck from us and i will talk fast and then tonia will go through the audits part and were happy to answer your questions at any point. Just to refresh your memories, the cycle that we follow is key to the citys fiscal year, we do work planning process during the spring in anticipation of issuing and finishing our work plan by june 30th. April, may and june and earlier than that is a heavy planning process with us. We look at a complex of different mandates, there are charter mandates we operate under, appendix f. There are requirements in the codes and grant and leases were responding to and various other audit requirements. We meet and speak with a variety of stakeholders, mayor, board of supervisors, yourself, we look at civil grand jury reports and anything that touch once the operating compliance in developing the work plan. Our budget looks like the city budget. We get a work order from all the different City Departments with an allocation and do work with and for them under the work order and whatever we dont spend is typically returned to the fund at the end of the fiscal year. There are a couple of departments where the last dollar is general fund dollars, so those are particularly returned to the general fund. In general, we spend something on the order of now 85 of the allocation, sometimes we go over on individual line items and then we have a balancing issue with those departments but we have never overspent our aggregate budget. Thats how we develop the work plan. This is a list of our issued reports during the First Six Months of the fiscal year in reverse chronological order. We have all of our standard reports that we have to issue for the performance side of the house have been issued. Those are, expecept for one, th performance report and scorecards and nonprofit monitoring report, the park standards report, the nonprofit monitoring report. The one standard issue report we do every year is street standards. Youll recall theres language for street cleanliness and standards we have a contractor under a Program Design in place for some years. We have good data set from them, very robust and geographic city wide. Were not happy with the data. We are looking at it and curious how it comports with other ways that the department of public works measures street cleanliness and maintenance and trying to make it match. We havent issued that report yet. I suspect we will before the end of the quarter but thats a gap on my mind as manager of the program. Just to let you know. So well go past the rest of the reports. I hope youve had a chance to look at some of them when issued. Just to highlight quickly, to give you examples and flavor of some of the work we do, were profiling four projects, muni Customer Service is one, this was a high priority of mta. In essence, working with the muni people, the ones who take the complaints, assign them to divisions in muni and theres a very serious in case you have made a complaint to muni, im sure some people feel unheard, thats an issue but theres a detailed process, whether theyre valid and act upon them. Go back if theyre valid, if theres not enough information they want to fill that gap. Our work was to sit with the people who do the intake, the investigations and video polls and go through all the processes and see where theres duplications and inefficiencies. I mention here a couple of the projects we came up with. At 311 they intake a lot of calls, sometimes they werent going through questions to investigate it, bus number, time of day, line number. If you have those you can investigate, if you dont, you cant. We want to have the protocol for the 311 operators. Modular housing, we had a request in a hurry from the Mayors Office to review the status of the modular housing industry. To oversimplify, the labor unions and community are concerned about how much or not the city might move to using modular housing as a possible approach or design particularly for homelessness housing and shelters quickly. They asked us to look at the status of the industry, have there been success stories, what are the implications in terms of cost and time to using modular housing. We did a lot of interviews with people in labor and craft organizations to understand their concerns. We looked at the projects and looked at the industry. We issued a report, which again i hope you got a chance to see. The very short highest level finding is that cost savings, somewhat moderate, probably there. Time savings are really more the issue. So the Mayors Office is still considering this. I dont think they have made final determinations but they put out an rfq to test the market of Housing Providers responsive to the citys needs in this area. Nonprofit monitoring program, you have heard me talk about this, just to give you an example, this program has gone on for many years and used to be we often couldnt see a problem with a nonprofit provider until they were in financial crisis or having a Service Issue or both, now failures of that type are exceedingly rare and you can see the improvement overtime. The number of contractors who have serious findings have gone way down, repeat findings is way down. The amount of technical systems has helped a lot of nonprofits straighten out their books and not fall into crisis. This program is a real Success Story and i hope the statistics are interesting. And lastly, the score cards and Performance Measures, ken you have kept an eye on this program for us over the years. We continue to make steady improvements for it. The one upper most on our minds right now, theres a civil grand jury report saying too many measures, too complicated. We said okay, we hear you but we worked really hard on the performance score cards to make that the simplest version of the entity, which is a city. And then theres also the Mayors Office before mayor lee passed away had been working on a strategic alignment. They asked all the departments to update plans and fit Performance Measures across city. Were trying to help align to the mayors work plan. Like anything else, its somewhat affected by the interim nature of the management in the Mayors Office now, proceeding with all the departments who successfully updated strategic plans and now moving to aligned work Performance Measures to match. We continue to make design improvements to the score cards so theyre more youres user friendly. The last throughslide is currens we were trying to finish during the fiscal year. Interdepartment working group, i could talk about it for a long time, but just to let you know, were working with the departments who have responses in the area basically to make sure the metrics are good so we know if we have succeeded or failed in response to homeless response. Police staffing when the mayor or the board goes to make decisions on Academy Classes for the next fiscal year, they have a real data basis to make that decision on. Were working with all the departments in the design of the permit center with the new building. Public health has a lot going on, well underway with Electronic Health records procurement. The lean partnership, were nearing the end toward a Successful Partnership which we have used lean methodologies to look at ways to stem inefficiencies and do a huge clean up. If you have looked at the before and after, maybe ill put pictures into the yearend slide deck. Its amazing what they have accomplished at the yard. And soon to issue charter required hours at the libraries, looking at the Branch Libraries and if theyre Meeting Needs being open as many days of the week and hours. We had a number of surveys and recommendations on how the libraries should expand open hours. Good morning toniss tonia leu from the Controllers Office. We will conduct a close out audit once the claim is closed and finished on the rebuild. We have prior to the close out through the process we completed about four additional audits on this particular bond project. So every year our audit team really strives to provide as much audit coverage as possible across the 50 plus departments. Looking at the various risks and activities through our city government. So slide 10 shows the various buckets we work in which include performance audit and these look at effectiveness, efficiency and economy of operations throughout the City Department and generally were doing several large audits across the city from an operational perspective. With the city wide audit program, were assessing the various key business processes across the department for compliance and effectiveness. Generally thats really around contracts and are you doing what you say youre doing. As it relates to it and system audits, we look at system, security, design and controls regarding that work and helping around resillancy. We have the Whistle Blower Program and provide Audit Related Services to various departments such as the Police Department as theyre working to resolve audit recommendations from the Blue Ribbon Committee and other regulatory organizations that look at them. Were also looking at the Police Department, helping the Police DepartmentAccountability Program set up their audit function and helping the Ethics Commission with some audit work as well. At different times departments ask for assistance to shore up in their operational areas and we do so because of our expertise. Construction, change management procedures, efficiency and effectiveness. Just to highlight construction audit work for the g. O. Bond expenditure for 2018 and 2012 program. You requested us to look at that work and audited two bond programs last fiscal year, 2008 rebuild and 2011 road repaving bond. For this year we added four more audits to determine if bond revenues are expended in accordance and no funds are used for salaries or operating expenses. We included 2008 and 12 clean and safe bonds. 2014 earthquake safety bond and 2015 Affordable Housing bond. Through the assistance of cummings, we have initiated the 2008 and 12 part bond audits in the field work phase and well complete an issue by april 2018 on that work. The other two will begin by quarter four of this fiscal year. I believe were on track as it relates to the bond expenditure audits. Relating to the committee benchmarking work that you requested us to look at, we have done that work, that work currently is in our Quality Assurance review process and just for a quick highlight, we have collected relevant data and identified other like committees and interviewed the committees and researched best practices. We benchmark five entities, four are in the city and one is out of the state. How you compare to the five benchmarks entities is that youre actually the only committee that has the mandate or authority to inform the public concerning the expenditure of general obligation bonds. We realize this committee is working on the next recommendations, identify standard reporting measures for all bond programs, should consider developing and implementing orientation or onboardin