Known concerns in the FAC data

Duplicate Valid Submissions

Clearinghouse staff — Wed, 01 Jul 2026 00:00:00 GMT

Summary

Duplicate submissions exist that should instead be treated as resubmissions or corrections

Discovered: Fri Apr 10 2026 00:00:00 GMT+0000 (Coordinated Universal Time)

Timeline to repair: TBD

Github issue:

#5464

Curation challenge

Before the FAC introduced a formal resubmission workflow, the only way for an auditee to correct or revise an audit was to submit an entirely new record. As a result, some organizations submitted what amounts to a second (or third, or fourth, etc) version of an audit as a fully independent, valid submission. These records are not flagged as resubmission or corrections, and each appears in the data as its own standalone audit.

A resubmission is identified as having matching "metadata" with a prior record. "Metadata" consists of the auditee UEI, EIN, audit year, entity name, and auditee email. Where those fields match across two or more records, the later accepted submissions are assumed to be resubmissions or corrections of the earlier one(s).

Example

This entity has two submissions for audit year 2023 with identical metadata. The earlier record was accepted in October 2023, and the corrected record followed in November.

Field	2023-03-GSAFAC-0000000881	2023-03-GSAFAC-0000007892
Accepted	2023-10-16	2023-11-22
UEI	J739DVTTLNE5	J739DVTTLNE5
EIN	720822689	720822689
Audit year	2023	2023
Auditee name	Housing Authority of Caldwell Parish	Housing Authority of Caldwell Parish
Auditee email	cpha@bellsouth.net	cpha@bellsouth.net

Consequences

Users querying or analyzing the data may encounter multiple seemingly independent submissions for the same organization and audit year. The most recent submission is not clearly identified as the authoritative version, and prior versions are not marked as deprecated or superceded.

Downstream calculations that aggregate data (award totals, finding counts, etc.) may double count values if all versions of a submission are included. Oversight officials relying on the data have no programmatic way to determine which submission reflects the final reported state without making significant assumptions about our data.

Mediating the error

Duplicate submissions can be identified by filtering for records that share the same UEI, EIN, audit year, entity name, and auditee email. Among those matching records, the submission with the latest acceptance date is almost certainly the authoritative "most recent" version.

Until duplicate records have been linked as resubmissions, users performing analysis may consider deduplicating on these fields and retaining only the most recently accepted record.

Possible resolution

A link_resubmissions management command has been created by the FAC team. The team will run the command for each audit year from 2016 to the current year. The command first identifies resubmission "chains", or sets of two or more records with identical metadata. These chains are added to a file that will undergo manual review by the FAC team.

Once the chains are confirmed as legitimate, records will be assigned version numbers in order of acceptance date and appropriate metadata will be writen to the internal record, including an administrative justification of FAC ADMIN CURATION ACTION for posterity. Then all affected records will be redisseminated to carry the change to the public. Records earliest in the chain will be marked as "deprecated", as they have been superceded by the newer versions. They will continue to exist, but they will not be casually available to the public.

The files that are generated as an artifact of this process will be cleaned up and released publicly to the FAC site, both as WWW content and as downloadable CSVs.

Incorrectly mapped MATERIALWEAKNESS

Clearinghouse staff — Wed, 11 Dec 2024 00:00:00 GMT

Summary

The value for a historical field was incorrectly mapped from Census to GSA

Discovered: Wed Nov 20 2024 00:00:00 GMT+0000 (Coordinated Universal Time)

Timeline to repair: TBD

Github issue: TBD

Curation challenge

The FAC received a helpdesk ticket reporting a data discrepancy between the new system and legacy concerning the fields is_internal_control_material_weakness_disclosed and MATERIALWEAKNESS (respectively).

According to the published data dictionary, the MATERIALWEAKNESS field in the legacy database should map to is_internal_control_material_weakness_disclosed in the new database. However, during data migration, the algorithm used MATERIALWEAKNESS_MP instead, causing a data inconsistency.

Example

As stated. Consistent for all records with a report_id containing CENSUS.

Consequences

This is an error in the data that was migrated.

This does not impact data collected currently (e.g. data with a report_id containing GSAFAC).

Mediating the error

Resolution officials should look at a different field in the data when making decisions.

Possible resolution

We need to update all 250K+ historical records to record the correct value.

Missing SF-SAC data

Clearinghouse staff — Wed, 20 Nov 2024 00:00:00 GMT

Summary

The SF-SAC for some historical submissions are not present.

Discovered: Wed Nov 20 2024 00:00:00 GMT+0000 (Coordinated Universal Time)

Timeline to repair: TBD

Github issue: TBD

Curation challenge

The handoff of data from Census to GSA was complete, but that does not mean the data itself was complete.

There are some submissions for which GSA has a report, but no SF-SAC data.

Example

We do not have SF-SAC data for the DBKEY 247658 in AUDITYEAR 2016.

Consequences

This is a hole in the historical record.

Mediating the error

Uknown at this time.

Possible resolution

Unknown at this time.

Missing SF-SACs

At this time, we believe the following 214 SF-SACs were lost at some point prior to the move to GSA.

Audit Year	DBKEY
2016	247658
2016	245687
2016	255666
2016	245797
2016	243781
2016	241142
2016	220881
2016	199903
2016	244464
2016	245891
2016	246032
2016	246503
2016	247345
2016	182108
2016	212404
2016	214227
2016	62641
2016	903732
2016	904350
2016	203150
2016	212516
2017	199802
2017	160841
2017	160839
2017	170077
2017	140482
2017	22798
2017	904393
2017	904549
2017	904675
2017	904088
2017	214227
2017	903932
2017	246862
2017	246823
2017	247262
2017	246762
2017	247342
2017	246691
2017	247743
2017	246478
2017	246430
2017	246272
2017	244887
2017	247788
2017	247208
2017	248837
2017	247015
2018	235223
2018	224327
2018	223089
2018	197898
2018	191929
2018	172153
2018	249006
2018	250448
2018	248685
2018	248511
2018	248837
2018	248198
2018	248119
2018	247095
2018	246668
2018	242635
2018	236124
2018	183892
2018	216261
2018	158744
2018	214227
2018	216431
2018	904633
2018	904137
2018	904329
2018	904391
2018	904433
2018	904468
2018	904536
2018	904580
2018	904101
2018	904773
2019	243753
2019	175190
2019	193973
2019	199272
2019	215660
2019	242795
2019	247742
2019	39290
2019	97795
2019	247820
2019	248449
2019	248665
2019	249016
2019	250537
2019	250771
2019	904593
2019	904594
2019	904719
2019	904788
2019	904451
2019	904459
2019	230793
2019	904471
2019	904325
2019	904368
2019	904445
2019	904479
2019	904500
2019	904512
2020	252358
2020	252394
2020	252832
2020	252834
2020	252846
2020	904559
2020	225532
2020	220815
2020	237347
2020	904551
2020	904666
2020	904690
2020	251235
2020	252835
2020	252847
2020	252893
2020	252950
2020	253125
2020	249245
2020	249479
2020	250294
2020	251197
2020	904484
2020	904699
2020	154277
2020	154246
2020	154247
2020	191445
2020	904555
2020	904618
2020	212403
2020	244421
2020	251253
2020	251299
2020	251746
2020	251860
2020	252203
2020	904566
2020	904727
2020	192416
2020	904608
2020	904615
2021	239186
2021	239456
2021	243104
2021	75839
2021	904769
2021	904774
2021	149070
2021	154246
2021	154247
2021	215977
2021	904639
2021	904644
2021	255084
2021	255204
2021	255900
2021	255956
2021	256443
2021	904573
2021	904581
2021	904603
2021	904605
2021	904610
2021	904667
2021	904676
2021	242836
2021	77249
2021	904686
2021	904715
2021	904650
2021	904653
2021	904654
2021	904660
2021	251089
2021	251650
2021	252346
2021	252461
2021	904647
2021	904648
2021	904777
2021	904779
2021	235314
2021	250946
2021	251025
2021	251076
2021	254211
2021	254414
2021	254122
2021	254714
2022	247680
2022	257745
2022	904751
2022	904753
2022	904756
2022	904739
2022	904748
2022	904749
2022	904752
2022	257168
2022	904706
2022	904750
2022	904763
2022	904764
2022	904776

Missing historical audit reports

Clearinghouse staff — Wed, 20 Nov 2024 00:00:00 GMT

Summary

The audit report for some historical SF-SACs are not present.

Discovered: Wed Nov 20 2024 00:00:00 GMT+0000 (Coordinated Universal Time)

Timeline to repair: TBD

Github issue: TBD

Curation challenge

The handoff of data from Census to GSA was complete, but that does not mean the data itself was complete.

There are some submissions for which GSA has data, but no report.

Example

We do not have a report for 2021-12-CENSUS-0000240867.

Consequences

This is a hole in the historical record.

Mediating the error

Uknown at this time.

Possible resolution

Unknown at this time.

Missing reports

At this time, we believe the following 658 reports were lost at some point prior to the move to GSA.

2019-06-CENSUS-0000228363
2019-06-CENSUS-0000228973
2020-06-CENSUS-0000008522
2020-06-CENSUS-0000147971
2020-06-CENSUS-0000171906
2020-06-CENSUS-0000194817
2020-06-CENSUS-0000223500
2020-06-CENSUS-0000226322
2020-06-CENSUS-0000228363
2020-06-CENSUS-0000248262
2020-06-CENSUS-0000254172
2020-08-CENSUS-0000235594
2020-09-CENSUS-0000089813
2020-09-CENSUS-0000211848
2020-09-CENSUS-0000245192
2020-09-CENSUS-0000245193
2020-12-CENSUS-0000117435
2020-12-CENSUS-0000135846
2020-12-CENSUS-0000156925
2020-12-CENSUS-0000234289
2020-12-CENSUS-0000243753
2020-12-CENSUS-0000256701
2020-12-CENSUS-0000256724
2020-12-CENSUS-0000256738
2021-01-CENSUS-0000239456
2021-04-CENSUS-0000138879
2021-04-CENSUS-0000248877
2021-06-CENSUS-0000029022
2021-06-CENSUS-0000081800
2021-06-CENSUS-0000082347
2021-06-CENSUS-0000100401
2021-06-CENSUS-0000119325
2021-06-CENSUS-0000125003
2021-06-CENSUS-0000132049
2021-06-CENSUS-0000143649
2021-06-CENSUS-0000171906
2021-06-CENSUS-0000185053
2021-06-CENSUS-0000201953
2021-06-CENSUS-0000223500
2021-06-CENSUS-0000242503
2021-06-CENSUS-0000246566
2021-06-CENSUS-0000248062
2021-06-CENSUS-0000254170
2021-06-CENSUS-0000254176
2021-06-CENSUS-0000254196
2021-06-CENSUS-0000256725
2021-09-CENSUS-0000089788
2021-09-CENSUS-0000152162
2021-09-CENSUS-0000170342
2021-09-CENSUS-0000254184
2021-09-CENSUS-0000256716
2021-09-CENSUS-0000256753
2021-10-CENSUS-0000066224
2021-11-CENSUS-0000191866
2021-12-CENSUS-0000003776
2021-12-CENSUS-0000004740
2021-12-CENSUS-0000012615
2021-12-CENSUS-0000015416
2021-12-CENSUS-0000022101
2021-12-CENSUS-0000023309
2021-12-CENSUS-0000053337
2021-12-CENSUS-0000065852
2021-12-CENSUS-0000098079
2021-12-CENSUS-0000116877
2021-12-CENSUS-0000121195
2021-12-CENSUS-0000134752
2021-12-CENSUS-0000143133
2021-12-CENSUS-0000148966
2021-12-CENSUS-0000163886
2021-12-CENSUS-0000171027
2021-12-CENSUS-0000176371
2021-12-CENSUS-0000178075
2021-12-CENSUS-0000181232
2021-12-CENSUS-0000182420
2021-12-CENSUS-0000183560
2021-12-CENSUS-0000194217
2021-12-CENSUS-0000207041
2021-12-CENSUS-0000219877
2021-12-CENSUS-0000219965
2021-12-CENSUS-0000224435
2021-12-CENSUS-0000227886
2021-12-CENSUS-0000228029
2021-12-CENSUS-0000233976
2021-12-CENSUS-0000234210
2021-12-CENSUS-0000234809
2021-12-CENSUS-0000237084
2021-12-CENSUS-0000237918
2021-12-CENSUS-0000240867
2021-12-CENSUS-0000241601
2021-12-CENSUS-0000246262
2021-12-CENSUS-0000248479
2021-12-CENSUS-0000249968
2021-12-CENSUS-0000251021
2021-12-CENSUS-0000251153
2021-12-CENSUS-0000251327
2021-12-CENSUS-0000252682
2021-12-CENSUS-0000254168
2021-12-CENSUS-0000254169
2021-12-CENSUS-0000254171
2021-12-CENSUS-0000254192
2021-12-CENSUS-0000254195
2021-12-CENSUS-0000254204
2021-12-CENSUS-0000254205
2021-12-CENSUS-0000256747
2021-12-CENSUS-0000256763
2022-06-CENSUS-0000076271
2022-06-CENSUS-0000078954
2022-06-CENSUS-0000201367
2022-06-CENSUS-0000245442
2021-06-CENSUS-0000242410
2021-06-CENSUS-0000236098
2021-12-CENSUS-0000047099
2021-12-CENSUS-0000097835
2021-09-CENSUS-0000206014
2021-06-CENSUS-0000170084
2021-06-CENSUS-0000170077
2021-12-CENSUS-0000088954
2021-12-CENSUS-0000246574
2021-06-CENSUS-0000205785
2021-12-CENSUS-0000222501
2021-12-CENSUS-0000238779
2021-12-CENSUS-0000098867
2021-12-CENSUS-0000219607
2021-12-CENSUS-0000146694
2021-06-CENSUS-0000002131
2021-12-CENSUS-0000152819
2021-12-CENSUS-0000223479
2021-12-CENSUS-0000040858
2021-12-CENSUS-0000230611
2021-12-CENSUS-0000200123
2021-12-CENSUS-0000254191
2021-12-CENSUS-0000202031
2021-12-CENSUS-0000146688
2021-12-CENSUS-0000186088
2021-12-CENSUS-0000099460
2021-12-CENSUS-0000241199
2021-12-CENSUS-0000059267
2021-06-CENSUS-0000133348
2021-12-CENSUS-0000133295
2021-06-CENSUS-0000194017
2021-12-CENSUS-0000166360
2021-12-CENSUS-0000233648
2021-12-CENSUS-0000245059
2021-06-CENSUS-0000254174
2021-12-CENSUS-0000076176
2021-12-CENSUS-0000245033
2021-06-CENSUS-0000254175
2021-12-CENSUS-0000176623
2021-06-CENSUS-0000131432
2021-12-CENSUS-0000137033
2021-06-CENSUS-0000248262
2021-11-CENSUS-0000138646
2021-01-CENSUS-0000084136
2021-12-CENSUS-0000148755
2021-06-CENSUS-0000254200
2021-06-CENSUS-0000134395
2021-06-CENSUS-0000158343
2021-06-CENSUS-0000179813
2021-06-CENSUS-0000247912
2021-06-CENSUS-0000214753
2021-12-CENSUS-0000251594
2021-06-CENSUS-0000194817
2021-12-CENSUS-0000256745
2021-06-CENSUS-0000249365
2021-12-CENSUS-0000236306
2021-12-CENSUS-0000225713
2021-03-CENSUS-0000186461
2021-12-CENSUS-0000241664
2021-12-CENSUS-0000130833
2021-12-CENSUS-0000204059
2021-09-CENSUS-0000241123
2021-12-CENSUS-0000258023
2021-09-CENSUS-0000136235
2021-06-CENSUS-0000208224
2021-11-CENSUS-0000080820
2021-12-CENSUS-0000249843
2021-12-CENSUS-0000256766
2021-12-CENSUS-0000117435
2021-12-CENSUS-0000236728
2021-12-CENSUS-0000228481
2021-12-CENSUS-0000188961
2021-12-CENSUS-0000247665
2021-12-CENSUS-0000086960
2021-12-CENSUS-0000256718
2021-12-CENSUS-0000256723
2021-12-CENSUS-0000216655
2021-12-CENSUS-0000256729
2021-12-CENSUS-0000187750
2021-06-CENSUS-0000221269
2021-06-CENSUS-0000160949
2021-09-CENSUS-0000231555
2021-12-CENSUS-0000234095
2021-09-CENSUS-0000208103
2021-09-CENSUS-0000172201
2021-12-CENSUS-0000191811
2022-06-CENSUS-0000102825
2022-06-CENSUS-0000184500
2022-06-CENSUS-0000207090
2022-06-CENSUS-0000214534
2022-06-CENSUS-0000132386
2022-06-CENSUS-0000232676
2022-06-CENSUS-0000122201
2022-06-CENSUS-0000240651
2022-06-CENSUS-0000215644
2022-06-CENSUS-0000079612
2022-06-CENSUS-0000180896
2022-06-CENSUS-0000214928
2022-09-CENSUS-0000183968
2022-06-CENSUS-0000211532
2022-06-CENSUS-0000229043
2022-06-CENSUS-0000120033
2022-06-CENSUS-0000185975
2022-06-CENSUS-0000097117
2022-09-CENSUS-0000089929
2022-06-CENSUS-0000117218
2022-06-CENSUS-0000218105
2022-06-CENSUS-0000113741
2022-06-CENSUS-0000194225
2022-06-CENSUS-0000107309
2022-06-CENSUS-0000164792
2022-06-CENSUS-0000078722
2022-09-CENSUS-0000211012
2022-06-CENSUS-0000076272
2022-09-CENSUS-0000183093
2022-06-CENSUS-0000099330
2022-06-CENSUS-0000205643
2022-06-CENSUS-0000156041
2022-02-CENSUS-0000249916
2022-06-CENSUS-0000204528
2022-06-CENSUS-0000182778
2022-06-CENSUS-0000137152
2022-06-CENSUS-0000072020
2022-06-CENSUS-0000064586
2022-06-CENSUS-0000256719
2022-09-CENSUS-0000229326
2022-06-CENSUS-0000256757
2022-06-CENSUS-0000220265
2022-06-CENSUS-0000199586
2022-06-CENSUS-0000169355
2022-06-CENSUS-0000087897
2022-09-CENSUS-0000056211
2022-09-CENSUS-0000182742
2022-06-CENSUS-0000137843
2022-09-CENSUS-0000186310
2022-06-CENSUS-0000208027
2022-06-CENSUS-0000048679
2022-06-CENSUS-0000186092
2022-06-CENSUS-0000256726
2022-06-CENSUS-0000131945
2022-06-CENSUS-0000231532
2022-06-CENSUS-0000227552
2022-06-CENSUS-0000149244
2022-08-CENSUS-0000256736
2022-07-CENSUS-0000229376
2022-09-CENSUS-0000232171
2022-06-CENSUS-0000231839
2022-06-CENSUS-0000256739
2022-06-CENSUS-0000155490
2022-09-CENSUS-0000186970
2022-06-CENSUS-0000158054
2022-06-CENSUS-0000161107
2022-06-CENSUS-0000204187
2022-09-CENSUS-0000222090
2022-09-CENSUS-0000184195
2022-06-CENSUS-0000027737
2022-06-CENSUS-0000129388
2022-06-CENSUS-0000238168
2022-07-CENSUS-0000248923
2022-06-CENSUS-0000004802
2022-09-CENSUS-0000007272
2022-06-CENSUS-0000095160
2022-09-CENSUS-0000071978
2022-06-CENSUS-0000227348
2022-09-CENSUS-0000079253
2022-06-CENSUS-0000229648
2022-06-CENSUS-0000089170
2022-09-CENSUS-0000224638
2022-06-CENSUS-0000125262
2022-09-CENSUS-0000224637
2022-09-CENSUS-0000101980
2022-06-CENSUS-0000168706
2022-06-CENSUS-0000113725
2022-03-CENSUS-0000224792
2022-10-CENSUS-0000219815
2022-09-CENSUS-0000089302
2022-09-CENSUS-0000242210
2022-06-CENSUS-0000245884
2022-06-CENSUS-0000197146
2022-06-CENSUS-0000200510
2022-09-CENSUS-0000238485
2022-08-CENSUS-0000207677
2022-06-CENSUS-0000129529
2022-06-CENSUS-0000130594
2022-06-CENSUS-0000248994
2022-06-CENSUS-0000182960
2022-06-CENSUS-0000184189
2022-06-CENSUS-0000223905
2022-09-CENSUS-0000242581
2022-06-CENSUS-0000256730
2022-06-CENSUS-0000125845
2022-06-CENSUS-0000220168
2022-06-CENSUS-0000089882
2022-06-CENSUS-0000026668
2022-06-CENSUS-0000219247
2022-06-CENSUS-0000179796
2022-06-CENSUS-0000214843
2022-06-CENSUS-0000214999
2022-09-CENSUS-0000182024
2022-06-CENSUS-0000253121
2022-09-CENSUS-0000232121
2022-03-CENSUS-0000251356
2022-03-CENSUS-0000256742
2022-09-CENSUS-0000230044
2022-06-CENSUS-0000240234
2022-09-CENSUS-0000256748
2022-06-CENSUS-0000088612
2022-09-CENSUS-0000238063
2022-09-CENSUS-0000227675
2022-06-CENSUS-0000221842
2022-06-CENSUS-0000242255
2022-06-CENSUS-0000118391
2022-09-CENSUS-0000218152
2022-06-CENSUS-0000251768
2022-06-CENSUS-0000252130
2022-09-CENSUS-0000224639
2022-09-CENSUS-0000237795
2022-05-CENSUS-0000202856
2022-09-CENSUS-0000246740
2022-06-CENSUS-0000182143
2022-09-CENSUS-0000116086
2022-04-CENSUS-0000139436
2022-03-CENSUS-0000256657
2022-08-CENSUS-0000256762
2022-06-CENSUS-0000102807
2022-06-CENSUS-0000130254
2022-09-CENSUS-0000239675
2022-08-CENSUS-0000019142
2022-06-CENSUS-0000256768
2022-09-CENSUS-0000187202
2022-06-CENSUS-0000003302
2022-06-CENSUS-0000004500
2022-06-CENSUS-0000211895
2022-12-CENSUS-0000252540
2022-12-CENSUS-0000227749
2022-12-CENSUS-0000237739
2022-12-CENSUS-0000241467
2022-12-CENSUS-0000220039
2022-12-CENSUS-0000207163
2022-12-CENSUS-0000236336
2022-12-CENSUS-0000073951
2022-12-CENSUS-0000212142
2022-12-CENSUS-0000245032
2022-12-CENSUS-0000240762
2022-12-CENSUS-0000226204
2022-12-CENSUS-0000238771
2022-12-CENSUS-0000243015
2022-06-CENSUS-0000194950
2022-09-CENSUS-0000235550
2022-06-CENSUS-0000251883
2022-06-CENSUS-0000210090
2022-06-CENSUS-0000221034
2022-09-CENSUS-0000224640
2022-09-CENSUS-0000224635
2022-09-CENSUS-0000224633
2022-10-CENSUS-0000044111
2022-06-CENSUS-0000161122
2022-04-CENSUS-0000224820
2022-06-CENSUS-0000143184
2022-06-CENSUS-0000195885
2022-06-CENSUS-0000224611
2022-06-CENSUS-0000248875
2022-06-CENSUS-0000246550
2022-05-CENSUS-0000247635
2022-06-CENSUS-0000190663
2022-09-CENSUS-0000078970
2022-06-CENSUS-0000201866
2022-06-CENSUS-0000223049
2022-06-CENSUS-0000091980
2022-09-CENSUS-0000053636
2022-12-CENSUS-0000224649
2022-12-CENSUS-0000223954
2022-12-CENSUS-0000228555
2022-12-CENSUS-0000239155
2022-12-CENSUS-0000220066
2022-12-CENSUS-0000230959
2022-12-CENSUS-0000250466
2022-12-CENSUS-0000220067
2022-07-CENSUS-0000011612
2022-12-CENSUS-0000206965
2022-12-CENSUS-0000019588
2022-12-CENSUS-0000223953
2022-12-CENSUS-0000194037
2022-12-CENSUS-0000221772
2022-12-CENSUS-0000242928
2022-12-CENSUS-0000220068
2022-12-CENSUS-0000241621
2022-12-CENSUS-0000238578
2022-12-CENSUS-0000238896
2022-12-CENSUS-0000220070
2022-09-CENSUS-0000019727
2022-12-CENSUS-0000226596
2022-06-CENSUS-0000156309
2022-09-CENSUS-0000250060
2022-09-CENSUS-0000220687
2022-06-CENSUS-0000089608
2022-06-CENSUS-0000067029
2022-06-CENSUS-0000206132
2022-06-CENSUS-0000032020
2022-06-CENSUS-0000183846
2022-06-CENSUS-0000158078
2022-06-CENSUS-0000218351
2022-06-CENSUS-0000075917
2022-06-CENSUS-0000141109
2022-09-CENSUS-0000066739
2022-06-CENSUS-0000227550
2022-06-CENSUS-0000210381
2022-04-CENSUS-0000243503
2022-05-CENSUS-0000208977
2022-09-CENSUS-0000186555
2022-06-CENSUS-0000027429
2022-06-CENSUS-0000246338
2022-09-CENSUS-0000222410
2022-06-CENSUS-0000243930
2022-06-CENSUS-0000195206
2022-06-CENSUS-0000244139
2022-06-CENSUS-0000144192
2022-09-CENSUS-0000241013
2022-04-CENSUS-0000097857
2022-05-CENSUS-0000026471
2022-09-CENSUS-0000244198
2022-06-CENSUS-0000252820
2022-06-CENSUS-0000067306
2022-09-CENSUS-0000104613
2022-08-CENSUS-0000248008
2022-09-CENSUS-0000204888
2022-09-CENSUS-0000227674
2022-01-CENSUS-0000904706
2022-12-CENSUS-0000249436
2022-09-CENSUS-0000150629
2022-12-CENSUS-0000213868
2022-12-CENSUS-0000241352
2022-06-CENSUS-0000161164
2022-12-CENSUS-0000062516
2022-06-CENSUS-0000244079
2022-06-CENSUS-0000246546
2022-06-CENSUS-0000185085
2022-06-CENSUS-0000073576
2022-06-CENSUS-0000246467
2022-06-CENSUS-0000183058
2022-06-CENSUS-0000181600
2022-09-CENSUS-0000215126
2022-06-CENSUS-0000218106
2022-06-CENSUS-0000215614
2022-06-CENSUS-0000256709
2022-06-CENSUS-0000080293
2022-10-CENSUS-0000244678
2022-06-CENSUS-0000046114
2022-09-CENSUS-0000250097
2022-06-CENSUS-0000073152
2022-04-CENSUS-0000092577
2022-06-CENSUS-0000174986
2022-09-CENSUS-0000197599
2022-06-CENSUS-0000046387
2022-09-CENSUS-0000215071
2022-09-CENSUS-0000183096
2022-09-CENSUS-0000185347
2022-03-CENSUS-0000186461
2022-06-CENSUS-0000231381
2022-06-CENSUS-0000240370
2022-06-CENSUS-0000218117
2022-06-CENSUS-0000229216
2022-09-CENSUS-0000090798
2022-06-CENSUS-0000154944
2022-06-CENSUS-0000247834
2022-06-CENSUS-0000225613
2022-06-CENSUS-0000256721
2022-06-CENSUS-0000182794
2022-06-CENSUS-0000249935
2022-06-CENSUS-0000246023
2022-06-CENSUS-0000132512
2022-06-CENSUS-0000196012
2022-09-CENSUS-0000242534
2022-08-CENSUS-0000177126
2022-09-CENSUS-0000190435
2022-12-CENSUS-0000030444
2022-05-CENSUS-0000187038
2022-09-CENSUS-0000229476
2022-09-CENSUS-0000230045
2022-06-CENSUS-0000236502
2022-06-CENSUS-0000046490
2022-04-CENSUS-0000256752
2022-06-CENSUS-0000256755
2022-02-CENSUS-0000096961
2022-06-CENSUS-0000216162
2022-09-CENSUS-0000224634
2022-06-CENSUS-0000117897
2022-06-CENSUS-0000109990
2022-08-CENSUS-0000104671
2022-06-CENSUS-0000086397
2022-03-CENSUS-0000253826
2022-06-CENSUS-0000202157
2022-06-CENSUS-0000225270
2022-04-CENSUS-0000230559
2022-06-CENSUS-0000143683
2022-05-CENSUS-0000096959
2022-06-CENSUS-0000240150
2022-09-CENSUS-0000172359
2022-06-CENSUS-0000210709
2022-06-CENSUS-0000224942
2022-06-CENSUS-0000144796
2022-06-CENSUS-0000144786
2022-06-CENSUS-0000256740
2022-05-CENSUS-0000096142
2022-09-CENSUS-0000223411
2022-06-CENSUS-0000256741
2022-06-CENSUS-0000161280
2022-06-CENSUS-0000188183
2022-06-CENSUS-0000149228
2022-09-CENSUS-0000221172
2022-06-CENSUS-0000155322
2022-06-CENSUS-0000182968
2022-06-CENSUS-0000248843
2022-06-CENSUS-0000247909
2022-05-CENSUS-0000026826
2022-09-CENSUS-0000225572
2022-05-CENSUS-0000214024
2022-06-CENSUS-0000215501
2022-06-CENSUS-0000188777
2022-09-CENSUS-0000137967
2022-04-CENSUS-0000231948
2022-09-CENSUS-0000252615
2022-06-CENSUS-0000188731
2022-09-CENSUS-0000188942
2022-09-CENSUS-0000229252
2022-09-CENSUS-0000027763
2022-09-CENSUS-0000218604
2022-08-CENSUS-0000051491
2022-06-CENSUS-0000191994
2022-06-CENSUS-0000243801
2022-06-CENSUS-0000206146
2022-06-CENSUS-0000040042
2022-06-CENSUS-0000256708
2022-06-CENSUS-0000107312
2022-06-CENSUS-0000086199
2022-06-CENSUS-0000227401
2022-06-CENSUS-0000179788
2022-04-CENSUS-0000195460
2022-06-CENSUS-0000256711
2022-06-CENSUS-0000247732
2022-06-CENSUS-0000195210
2022-06-CENSUS-0000252422
2022-06-CENSUS-0000195226
2022-06-CENSUS-0000034371
2022-09-CENSUS-0000007480
2022-06-CENSUS-0000214081
2022-06-CENSUS-0000158018
2022-06-CENSUS-0000149218
2022-09-CENSUS-0000186314
2022-09-CENSUS-0000198720
2022-06-CENSUS-0000256715
2022-06-CENSUS-0000166249
2022-10-CENSUS-0000180941
2022-09-CENSUS-0000189679
2022-06-CENSUS-0000147098
2022-06-CENSUS-0000028552
2022-08-CENSUS-0000256717
2022-08-CENSUS-0000054216
2022-09-CENSUS-0000026933
2022-06-CENSUS-0000171888
2022-06-CENSUS-0000201281
2022-06-CENSUS-0000225201
2022-06-CENSUS-0000252969
2022-06-CENSUS-0000193632
2022-06-CENSUS-0000188745
2022-06-CENSUS-0000216169
2022-06-CENSUS-0000050094
2022-06-CENSUS-0000235673
2022-09-CENSUS-0000183220
2022-06-CENSUS-0000022931
2022-06-CENSUS-0000095029
2022-06-CENSUS-0000193723
2022-09-CENSUS-0000253661
2022-06-CENSUS-0000208003
2022-06-CENSUS-0000243530
2022-09-CENSUS-0000115836
2022-06-CENSUS-0000235295
2022-06-CENSUS-0000207667
2022-06-CENSUS-0000205815
2022-12-CENSUS-0000216139
2022-06-CENSUS-0000258026
2022-09-CENSUS-0000211446
2022-09-CENSUS-0000120172
2022-12-CENSUS-0000111619
2022-06-CENSUS-0000134204
2022-12-CENSUS-0000258022
2022-12-CENSUS-0000193553
2022-12-CENSUS-0000036034
2022-06-CENSUS-0000169915
2022-12-CENSUS-0000258024
2022-12-CENSUS-0000037060
2022-12-CENSUS-0000216430
2022-09-CENSUS-0000249500
2022-12-CENSUS-0000220069
2022-12-CENSUS-0000229844
2022-12-CENSUS-0000216458
2022-12-CENSUS-0000236467
2022-09-CENSUS-0000049384
2022-12-CENSUS-0000226606
2022-12-CENSUS-0000221771
2022-12-CENSUS-0000249743
2022-12-CENSUS-0000236278
2022-11-CENSUS-0000181251
2022-06-CENSUS-0000165509
2022-09-CENSUS-0000230355
2022-12-CENSUS-0000183739
2022-07-CENSUS-0000258014
2022-12-CENSUS-0000250648
2022-06-CENSUS-0000258019
2022-06-CENSUS-0000250175
2022-12-CENSUS-0000206950
2022-12-CENSUS-0000252569
2022-09-CENSUS-0000136138
2022-09-CENSUS-0000136440
2022-12-CENSUS-0000246179
2022-09-CENSUS-0000236462
2022-09-CENSUS-0000236461
2022-12-CENSUS-0000213420
2022-06-CENSUS-0000235083
2022-12-CENSUS-0000258027
2022-12-CENSUS-0000227750
2022-06-CENSUS-0000209674
2022-07-CENSUS-0000238294
2022-12-CENSUS-0000229842
2022-12-CENSUS-0000253050
2022-12-CENSUS-0000221773
2022-06-CENSUS-0000147954
2022-09-CENSUS-0000212112
2022-12-CENSUS-0000184011
2022-12-CENSUS-0000202202
2022-12-CENSUS-0000245401
2022-06-CENSUS-0000054828
2022-06-CENSUS-0000216929
2022-09-CENSUS-0000247571
2022-06-CENSUS-0000161730
2022-12-CENSUS-0000227977
2022-12-CENSUS-0000247250
2022-06-CENSUS-0000152584
2022-09-CENSUS-0000179716
2022-12-CENSUS-0000230234
2022-07-CENSUS-0000200901
2022-12-CENSUS-0000224098
2022-12-CENSUS-0000219031
2022-12-CENSUS-0000249443
2022-12-CENSUS-0000251141
2022-06-CENSUS-0000227685
2022-09-CENSUS-0000258020
2022-06-CENSUS-0000249118
2022-12-CENSUS-0000258025

Historical submissions beyond recovery

Clearinghouse staff — Thu, 17 Oct 2024 00:00:00 GMT

Summary

The SF-SAC for two submissions were beyond recovery in migration

Discovered: Thu Oct 17 2024 00:00:00 GMT+0000 (Coordinated Universal Time)

Timeline to repair: TBD

Github issue: TBD

Curation challenge

The handoff of data from Census to GSA was complete, but that does not mean the data itself was complete.

There are two submissions for which the data was irrecoverable.

Example

We do not have SF-SAC data for:

DBKEY 243753, AUDITYEAR 2019
DBKEY 247680, AUDITYEAR 2022

Consequences

This is a hole in the historical record.

Mediating the error

Uknown at this time.

Possible resolution

Unknown at this time.

Migrated accepted dates are incorrect

Clearinghouse staff — Mon, 01 Jul 2024 00:00:00 GMT

Summary

The accepted date in migrated records used the wrong historical date field.

Discovered: 2024-07

Timeline to repair: TBD

Github issue: TBD

Curation challenge

As part of the move from Census to GSA, we migrated the SF-SAC records from 2016-2022. To complete this migration, we treated every record from Census as a submission to GSA. Unfortunately, Census record multiple acceptance dates for submissions:

There was a DATERECEIVED, which was when an audit was submitted to the Census Clearinghouse.
There was a DATEACCEPTED, which is when the audit was deemed to be acceptable for submission.
There was a DATEFIREWALL, which is when the audit was published to agencies and the public.

The GSA Clearinghouse only records one acceptance date, which we call fac_accepted_date. When bringing historical records forward, we used the Census field FACACCEPTED, believing it was equivalent to our fac_accepted_date. It is not; we should have, instead, used DATEFIREWALL. To further complicate the issue, we applied the same transformation to this date as all other dates, which means that we not only chose the wrong date, but we subtracted one from it.

The error is in end_to_end_core.py on line 69. This impacts all records migrated from Census.

Example

Any record migrated from Census will demonstrate this issue. For example:

Report ID	Entity	Incorrect date	Correct date
2022-06-CENSUS-0000212928	Gulf of Maine Research Institute	Dec. 27, 2022	Jan. 3, 2023
2022-06-CENSUS-0000091651	Berea College	Nov. 22, 2022	Nov. 30, 2022
2022-06-CENSUS-0000211679	Franklin W. Olin College of Engineering, Inc.	Nov. 16, 2022	Nov. 28, 2022

Consequences

This impacts searches for audits in past years when using the acceptance date as a criterion. In theory, an audit that was late may now appear as if it was on time.

Mediating the error

If an agency has stored historical data from Census, those records could be consulted. Otherwise, there is no end-user mediation for this error. The FAC must correct the record.

Possible resolution

Update the records containing incorrect dates, and re-disseminate the record. This will yield correct data in the public-facing tables.

Incorrect report identifiers

Clearinghouse staff — Mon, 01 Apr 2024 00:00:00 GMT

Summary

Report IDs are based in part on (possibly incorrect) user-entered data.

Discovered: 2024-04

Timeline to repair: TBD

Github issue: TBD

Curation challenge

Because of how/when we construct record ids, some of them are incorrect. For example, if a user creates an audit that (incorrectly) indicates a FY22 end date, we will (forever) report that audit submission as 2022-MM-GSAFAC-##########.

If we are going to assign semantics to this identifier (e.g. the first four digits are the audit’s fiscal year), then we should enforce that. Or, we should disclaim the semantics.

Example

See above.

Consequences

There is no indication to a resolution official what is the correct fiscal year for the audit in question when looking at the SF-SAC data. However, the report will contain the correct information.

Fiscal year is not a common search term for resolution officials (from our research), and this is unlikely to have a significant impact on resolution/oversight.

Mediating the error

There is no clear end-user mediation, other than looking at the Single Audit Report for the correct data.

Possible resolution

We need a way to associate more than one report id with a record, and indicate which is “primary.” In this way, we can retain old (incorrect) ids with some records, and then associate a new (correct) id with it. The primary id should be used as the default in all views.

This is difficult in dissemination, and may require changes to our model.

Migrated fiscal year dates off-by-one

Clearinghouse staff — Fri, 01 Mar 2024 00:00:00 GMT

Summary

The fiscal year start and end date in migrated records are one day early.

Discovered: 2024-03

Timeline to repair: TBD

Github issue: TBD

Curation challenge

Our server records time in GMT.
We treat all submissions as if they were in SST (Samoa Standard Time)

What this means is that when someone submits data to the FAC, we look at the timestamp (in GMT), and subtract 11 hours (because we pretend the submission is coming from American Samoa). We do this to make sure that submissions from everywhere that might submit a Single Audit is considered "on time" as long as the grantee completes the submission on or before the day it is due.

This transformation makes sense for new submissions to the GSA FAC. It did not make sense for data we were migrating from Census. Because we subtracted 11 hours from every acceptance date coming from Census, it had the effect of moving those dates back one day.

The source of the error can be found in sac_creation.py in the code.

Example

Any record migrated from Census will demonstrate this issue. For example:

Report ID	Entity	Incorrect date	Correct date
2022-06-CENSUS-0000212928	Gulf of Maine Research Institute	Dec. 27, 2022	Dec. 28, 2022
2022-06-CENSUS-0000091651	Berea College	Nov. 22, 2022	Nov. 23, 2022
2022-06-CENSUS-0000211679	Franklin W. Olin College of Engineering, Inc.	Nov. 16, 2022	Nov. 17, 2022

Consequences

This impacts searches for audits in past years when using the acceptance date as a criterion. An audit that was submitted one day late will now appear on-time.

Mediating the error

End users can read fiscal year dates as one more than they are.

Possible resolution

Update the records containing incorrect dates, and re-disseminate the record. This will yield correct data in the public-facing tables.

Incorrect name field used

Clearinghouse staff — Tue, 13 Feb 2024 00:00:00 GMT

Summary

The certifying names were drawn from a similar, but incorrect, field

Discovered: Tue Feb 13 2024 00:00:00 GMT+0000 (Coordinated Universal Time)

Timeline to repair: TBD

Github issue: TBD

Curation challenge

While preparing the data migration documentation, it was noted that AUDITEENAME was incorrectly used instead of AUDITEECERTIFYNAME, and AUDITEETITLE was used instead of AUDITEECERTIFYTITLE. It was determined that this will have a low impact on the disseminated reports as it does not affect the financial aspect of the audit reports and only affects the auditee certifying information. However, because this still introduces some data inaccuracies in the reports in production, it must be addressed.

Example

See any record with CENSUS in the report id (e.g. https://app.fac.gov/dissemination/summary/2019-12-GSAFAC-0000351778). The error is almost impossible to descern, as it involves a name-based field that was similar, and therefore the names and titles still look correct.

Consequences

This does not have a material impact on resolution work.

Mediating the error

There is no immediate remediation; the name and title used is accurate, but it is technically drawn from the wrong field in the historical data.

Possible resolution

We need to update all 250K+ historical records to record the correct value.

Duplicated data rows

Clearinghouse staff — Thu, 01 Feb 2024 00:00:00 GMT

Summary

Some rows in some tables from the 2023 data collection are duplicated.

Discovered: 2024-02

Timeline to repair: TBD

Github issue: TBD

Log: 2025-01-remove-duplicates

Curation challenge

In February of 2024, we discovered a bug where, if users pressed the "submit" button twice in rapid successesion, some data in the FAC database could be duplicated. Investigation determined that this did not impact the internal records of the SF-SAC collection, but it did impact how the data was copied out to our dissemination data tables. The dissemination tables power our search and API, and therefore impact all users of the data.

Example

Some records in the federal_awards and findings tables can be replicated because of this bug. For example, report 2023-06-GSAFAC-0000020785 encountered this bug. As a result, its award rows were duplicated. Below is a subset of rows from the federal_awards data table demonstrating how a set of awards were listed twice.

report_id	reference	prefix	extension
2023-06-GSAFAC-0000020785	AWARD-0001	93	959
2023-06-GSAFAC-0000020785	AWARD-0002	93	959
2023-06-GSAFAC-0000020785	AWARD-0003	93	778
2023-06-GSAFAC-0000020785	AWARD-0001	93	959
2023-06-GSAFAC-0000020785	AWARD-0002	93	959
2023-06-GSAFAC-0000020785	AWARD-0003	93	778

Our data validation process would not allow a user to enter this data this way; each AWARD-#### can only appear once. This error occurred when the data was copied into our dissemination tables (used by search and the API). Anyone requesting the federal awards for report GSA-20785 will get two AWARD-0001 rows, two AWARD-0002 rows, and so on.

Consequences

Searches for audits are not impacted, but calculations over the awards may yield incorrect results.

Mediating the error

In the federal_awards table, a given AWARD reference should only occur once. Filtering this down to a unique set will yield correct results.
In the findings table, a given AWARD and REF should only appear once in combination; filtering this combination of identifiers down to a unique set will yield correct results.

Possible resolution

Remove the records from dissemination that contain this error, and re-disseminate the original record. This will yield correct data in the public-facing record.

Removal of incorrect audits

Clearinghouse staff — Wed, 01 Nov 2023 00:00:00 GMT

Summary

Some audits were submitted with completely incorrect information.

Discovered: 2023-11

Timeline to repair: TBD

Github issue: TBD

Curation challenge

A user looked up their UEI in SAM.gov. It was for the Newark Housing Authority They submitted. They then realized they meant to submit for the Newark Housing Authority, which has a different UEI, and submitted again.

The first of these two is simply incorrect, and needs to be removed.

This is not the only example of this kind of problem within the system, and a mechanism by which the FAC can remove audits from circulation that are simply in error is needed.

Example

See above.

Consequences

There is no indication to a resolution official which audit is correct or incorrect. It is likely to be resolved through the resolution process, but it would be better if the FAC curated the data and removed the incorrect audit submissions.

Mediating the error

There is no clear mediation pathway for users.

Possible resolution

We will want a documented process for removing audits we believe to be in error. This process may involve a positive assertion (documented) from the auditor and auditee certifying officials that the audit in question should be removed. Consultation with OMB and OIGs will be necessary before implementing an SOP regarding this kind of error.

We will likely maintain the record internally, but flag it as in-error. This way, if we are wrong in our assessment, we do not lose the data.