ISOIECTR24028-2020信息技术人工智能人工智能的可信度概述.docx

TECHNICALREPORTISO/IECTR24028Firstedition2020-05InformationtechnologyArtificialintelligence-OverviewoftrustworthinessinartificialintelligenceTechnologiesdeVinformationIntelligenceartificielleExamend'ensembledelaJkIbiIiiCenmatieredintelligenceartificielle3 by *<Siow hNo reproduction Or Gtworkng PeEned without license from IHSNot for fwte.06103-202020 29:40 MDTReferencenumberISO/IECTR24028:2020(E)COPYRIGHTPROTECTEDDOCUMENTISO/EC2()20Allrightsreserved.Unlessotherwisespecified,orrequiredinthecontextofitsimplementation,nopartofthispublicationmaybereproducedorutilizedotherwiseinanyformorbyanymeans,electronicormechanical,includingphotocopying,orpostingontheinternetoranintranet,withoutpriorwrittenpermission.PermissioncanberequestedfromeitherISOaltheaddressbeloworISO'smemberbodyinthecountryoftherequesterISOcopyrightofficeCP401Ch.deBlandonnet8CH-1214Vemier1GenevaPhone:+41227490111Fax41227490947Email:copyrightiso.orgWebsite:www.iso.orgPublishedinSwitzerlandmationalOrganizatianforStarxSarcizationProvidedbyIHSMar¼tunderIioemewithIECNorproductaarnetwolhgPennaedwithotlicensefromHSPageviJ J J.7.77.881010UU12121313131414141515151516161616161717171718181919192121212122222323232424iiiContentsIntroduction1 Scope2 Normativereferences3 Termsanddefinitions4 Overview5 Existingframeworksapplicabletotrustworthiness5.1 Background5.2 Recognitionoflayersoftrust5.3 Applicationofsoftwareanddataqualitystandards5.4 Applicationofriskmanagement5.5 Hardware-assistedapproaches6 Stakeholders6.1 Generalconcepts6.2 Types6.3 AsSets6.4 Values7 Recognitionofhigh-levelconcerns7.1 Responsibility,accountabilityandgovernance7.2 Safety8 Vulnerabilities,threatsandchallenges8.1 General8.2 AIspecificsecuritythreats8.2.1 General8.2.2 Datapoisoning8.2.3 Adversarialattacks8.2.4 Modelstealing8.2.5 Hardware-focusedthreatstoconfidentialityandintegrity8.3 Alspecificprivacythreats8.3.1 General8.3.2 Dataacquisition8.3.3 Datapre-processingandmodelling8.3.4 Modelquery8.4 Bias8.5 Unpredictability8.6 Opaqueness8.7 ChallengesrelatedtothespecificationofAlsystems8.8 ChallengesrelatedtotheimplementationofAlsystems8.8.1 Dataacquisitionandpreparation8.8.2 Modelling8.8.3 Modelupdates8.8.4 Softwaredefects8.9 ChallengesrelatedtotheuseOfAlSyStems8.9.1 Human-computerinteraction(HCI)factors8.9.2 MisapplicationofAlsystemsthatdemonstraterealistichumanbehaviour.8.10 Systemhardwarefaults9 Mitigationmeasures9.1 General9.2 Transparency9.3 ExplainabilityCoprioht nenstlSO/ IEC 2O2> Allrights rescncrPRividoI by IHS Markil IlXJCT iccnse with IECNV *eMi*liAif *M (l*tvlit: (»3«ifNcd *ilHwl Iktfnc f<n IliS9.3.1 GeneralO14.56.7.89JJ99.999.9999.3.2 Aimsofexplanation9.3.3 Ex-antevsex-postexplanation9.3.4 Approachestoexplainability9.3.5 Modesofex-postexplanation9.3.6 1.evelsofexplainability9.3.7 EvaluationoftheexplanationsControllability9.4.1 General9.4.2 Human-in-the-loopcontrolpointsStrategiesforreducingbiaPrivacyReliability,resilienceandrobustnessMitigatingsystemhardwarefaultsFunctionalsafetyTestingandevaluation9.10.1 General9.10.2 Softwarevalidationandverificationmethods9.10.3Robustnessconsiderations9.10.4 Privacy-relatedconsiderations9.10.5 SystempredictabilityconsiderationsUseandapplicability9.11.1 Compliance9.11.2 Managingexpectations9.11.3 Productlabelling9.11.4 Cognitivescienceresearch.24242525,26272727282828282929303030323333M.34M.3434AnnexA(infbrmative)RelatedWOrkolISOCietalissues36Bibliography37CoPvVOhlIGrMrtiOnalOrganizationRxSumdiWEitionPiwidedbvIHSMarhkiiunderIiCabewithIECNoptsJulMi*etM>lMUeemilloJsiiaUKittlefruIHSISO/IEC2020-A11rightsreservedNoifo<Resale.O6IO32O2O2029:40MDTForewordISO(theInternationalOrganizationforStandardization)andIEC(theInternationalElectrotechnicalCommission)formthespecializedsystemforworldwidestandardization.NationalbodiesthataremembersofISOorIECparticipateinthedevelopmentofInternationalStandardsthroughtechnicalcommitteesestablishedbytherespectiveorganizationtodealwithparticularfieldsoftechnicalactivity.ISOandIECtechnicalcommitteescollaborateinfieldsofmutualinterest.Otherinternationalorganizations,governmentalandnon-governmental,inliaisonwithISOandIEC,alsotakepartinthework.TheproceduresusedtodevelopthisdocumentandthoseintendedforitsfurthermaintenancearedescribedintheISO/IECDirectives,Partl.Inparticular,thedifferentapprovalcriterianeededforthedifferenttypesofdocumentshouldbenoted.ThisdocumentwasdraftedinaccordancewiththeeditorialrulesoftheISO/IECDirectives,Part2(seewwwiso.org/directives).Attentionisdrawntothepossibilitythatsomeoftheelementsofthisdocumentmaybethesubjectofpatentrights.ISOandIECshallnotbeheldresponsibleforide