EVALUATION OF THE
Communications with respect to this document should be addressed to:
EVALUATION OF THE
The United States Department of Justice ("the Department"), pursuant to Section 271(d)(2)(A) of the Telecommunications Act of 1996(1) ("the 1996 Act"), submits this Evaluation of the application filed on July 17, 2003, by SBC Communications Inc., Illinois Bell Telephone Company, Indiana Bell Telephone Company, the Ohio Bell Telephone Company, Wisconsin Bell, Inc., and Southwestern Bell Communications Services, Inc. (collectively, "SBC") to provide in-region, interLATA services in Illinois, Indiana, Ohio, and Wisconsin.
This application to the Federal Communications Commission ("FCC" or "Commission") is SBC's first for these states and follows closely on the heels of its fourth application for long distance authority in Michigan, which is pending.(2) The Department's evaluation of that application ("Michigan III Evaluation") focused on issues pertaining to accuracy of wholesale billing, provisioning of line-splitting, and reliability of performance data.(3) The Department found that, although SBC had made progress in addressing many of these concerns, it could not support the application based on the then current record as to billing problems.(4) The Department did not, however, foreclose the possibility that the Commission could determine that the concerns were adequately addressed prior to the conclusion of its review.(5)
As the Department has explained, in-region, interLATA entry by a regional Bell Operating Company ("BOC") should be permitted only when the local markets in a state have been "fully and irreversibly" opened to competition.(6) Although SBC has made progress in addressing some of the issues raised in the Michigan II and Michigan III evaluations, the Department finds that issues remain concerning the billing processes that are common to Michigan and the four states that are the subject of the current application, and these issues preclude the Department from supporting this application based on the current record. The Department does not, however, foreclose the possibility that the Commission may be able to determine that these concerns have been adequately addressed prior to the conclusion of its review. In addition, the Department notes several other issues that deserve the Commission's careful attention, including manual handling, line-splitting, pricing, and data reliability.
The Illinois Commerce Commission ("Illinois CC") facilitated the development of competition in local telecommunications markets by adopting carrier-to-carrier wholesale performance measurements and selecting BearingPoint to administer a third-party test of SBC's OSS,(7) conducting pricing proceedings to establish wholesale rates for unbundled network elements ("UNEs"),(8) and approving a remedy plan (the "Compromise Plan") established in conjunction with several CLECs.(9) The Illinois CC found SBC to be compliant with the standards of Section 271(10) and endorsed SBC's application to the FCC.(11)
The Indiana Utility Regulatory Commission ("Indiana URC") facilitated the development of competition in local telecommunications markets by adopting carrier-to-carrier wholesale performance measurements and selecting BearingPoint to administer a third-party test of SBC's OSS,(12) conducting a pricing proceeding to establish UNE rates,(13) and approving an "SBC Indiana Section 271 Remedy Plan."(14) The Indiana URC found SBC to be "largely in compliance" with the standards of Section 271,(15) but ultimately deferred to the FCC to "determine whether local markets have been fully and irreversibly open to competition, and that SBC has demonstrated sufficient accuracy of its systems data and wholesale billing reliability."(16)
The Public Utilities Commission of Ohio ("Ohio PUC") facilitated the development of competition in local telecommunications markets by adopting carrier-to-carrier wholesale performance measurements and selecting BearingPoint to administer a third-party test of SBC's OSS,(17) conducting pricing proceedings to establish wholesale UNE rates,(18) and affirming that the Ohio Remedy Plan was sufficient for the purposes of satisfying the requirements of Section 271.(19) The Ohio PUC found SBC to have satisfied the standards of Section 271(20) and recommended that the FCC approve SBC's application.(21)
The Public Service Commission of Wisconsin ("Wisconsin PSC") facilitated the development of competition in local telecommunications markets by adopting carrier-to-carrier wholesale performance measurements,(22) retaining BearingPoint to administer a third-party test of SBC's OSS,(23) and conducting a pricing proceeding to establish wholesale rates for UNEs.(24) However, the Wisconsin PSC declined to comment on the adequacy of the Wisconsin Compromise Remedy Plan for the purposes of a Section 271 proceeding.(25) The Wisconsin PSC found SBC to be compliant with the standards of Section 271(26) and recommended that the FCC approve SBC's application.(27)
In assessing whether the local markets in a state are fully and irreversibly open to competition, the Department looks first to the actual entry in a market.(28) The Department does not, however, broadly presume that all three entry tracks facilities-based, UNEs, and resale are open or closed on the basis of an aggregate level of entry alone.(29) The following table reports CLEC entry in Illinois, Indiana, Ohio, and Wisconsin in terms of shares of total residential and business lines served and shares of residential and business lines served by means of each mode of entry.
Given the regional nature of SBC's OSS,(32) the Department evaluates entry regionwide, taking note that pricing or other state-specific factors may significantly affect the degree to which CLECs use a specific mode in a specific state. In the states addressed in this application, the levels of entry and the absence of evidence that entry has been unduly hindered by problems with obtaining inputs from SBC lead the Department to conclude that opportunities are available to competitive facilities-based carriers serving business customers. Although residential entry through the UNE-platform, in particular, appears noteworthy, the concerns identified below preclude a conclusion based on the existing record that for other modes of entry the local markets in these states are and will remain open to competitive entry.
SBC uses the same operations support systems ("OSS") across all five states in the Ameritech region, including the four involved in the present application. Thus, issues concerning OSS are generally the same throughout the four states, although when individual CLECs operate only in one or two states, they may focus on problems in only those states. The Department addresses below issues raised by the CLECs concerning wholesale billing accuracy, manual handling of some orders, and line-splitting.(33)
The billing systems employed in the four-state SBC/Ameritech region are the same as those employed in Michigan.(34) In its recent Evaluation of SBC's re-filed Section 271 application for Michigan, the Department observed that while SBC had made "significant efforts to improve its billing performance, . . . persistent questions remain concerning billing accuracy."(35) Because the record did not contain evidence from which the Department could conclude that these concerns were insignificant or that they had been adequately addressed, the Department was not able to support SBC's application for long distance authority in Michigan. The Department has sought from SBC, both in the Michigan proceedings and in the present one, additional information that would allow the Department to draw a different conclusion. However, as discussed below, the limited information provided by SBC is insufficient to alleviate the concerns raised in the Michigan III Evaluation, which persist here.
The record before the Department in the Michigan proceeding included SBC's own billing affidavit, which showed that CLECs continued to experience billing accuracy problems of various types.(36) In addition, the CLECs alleged with some supporting information that they were currently receiving wholesale bills from SBC that contained substantial inaccuracies.(37) In this proceeding CLECs reiterate the billing accuracy issues they raised in Michigan.(38) The CLECs also raise new issues concerning ongoing billing problems with SBC. Substantial showings are made by several small CLECs that operate in one or more of the four states, such as CIMCO, Forte, and NTD.(39) Forte alleges that over the past two years, 25 to 35 percent of its bills have contained overcharges.(40) A larger CLEC, TDS Metrocom, reports that since August 2002 it has opened disputes on approximately 20 percent of the total amount billed to it by SBC.(41) TDS Metrocom asserts that 87 percent of these disputes have been resolved in its favor.(42)
Some of the state commissions have also raised concerns about billing issues. The Indiana URC, for example, observed:
The Indiana Commission specifically asks for the FCC's assistance in ensuring that "these potential problems," to the extent they are not being addressed, are "in fact corrected."(44) The Wisconsin Commission has recently opened a comprehensive investigation into SBC's wholesale billing.(45) To date, more than 65 billing issues have been raised by the CLECs in that proceeding.(46)
The Commission and the Department have observed that inaccurate wholesale billing can impair competition in the local exchange market. It "diverts CLEC resources to bill reconciliation and correction, hampers CLEC ability to raise capital because improper overcharges are carried on the CLECs' financial reports, diminishes CLEC capacity to adjust prices and expenses in response to competition, and deprives CLECs of revenue because they are unable to back-bill previously undercharged end users."(47) CLECs have submitted data to establish that such effects are being felt in the SBC/Ameritech region.(48) In addition to the time and expense associated with reviewing and submitting claims, CLECs also complain about the length of time it takes SBC to investigate and resolve billing disputes.(49) Although SBC apparently has stepped up its effort to credit CLECs for over-billing, resolution of these claims can take months and, as SBC readily admits, is "laborious and resource-intensive[.]"(50) Back-billing also appears to be a major source of problems for numerous CLECs.(51)
The Department cannot, of course, verify that every CLEC complaint about billing is correct. Moreover, the CLECs could have more fully demonstrated the extent to which these problems have adversely affected their ability to compete. The Department believes, however, that enough has been shown to raise a genuine issue.(52) As the Commission recognizes, the BOC itself "must demonstrate that it can produce a readable, auditable, and accurate wholesale bill."(53) That is true not only because the BOC is the proponent of its own application, but for a very practical reason. The records and information held by the BOC are critical to any determination of whether it is accurately billing the CLECs.
SBC has not provided information sufficient to show either (1) that its erroneous bills comprise only an insignificant proportion of its total billings or (2) that it has implemented a lasting solution to its billing accuracy problems. In its Michigan III Evaluation, the Department noted SBC's acknowledged billing problems of the recent past, and observed that "SBC does not offer any objective measure to demonstrate that its actual billing performance is improving."(54) To date SBC has not offered any such objective measure. Nor has SBC shown that it has undertaken to comprehensively examine the databases and processes that now supply information inputs to its billing systems.(55)
In its supplemental reply filing in Michigan, SBC discusses billing issues.(56) It describes steps it is taking to address those issues, including installation of a database to track settlements and adjustments over $50,000, which "provides a means to sort data by root cause to determine trends and potential areas in need of process improvements."(57) At the same time, however, the reply filing raises additional concerns. SBC acknowledges there the validity of additional billing claims made by the CLECs,(58) as well as problems not yet discovered by the CLECs.(59) Whether the problem lies in SBC's actual billing systems, inputs to its billing systems, or with some other aspect of its OSS, the CLECs continue to receive erroneous bills. SBC reports that it has implemented fixes for some of the problems.(60) Nevertheless, in the absence of a showing that billing errors are proportionately insignificant, the fact that new errors continue to arise suggests that SBC still has trouble generating accurate bills, and needs to implement a lasting and comprehensive solution.
The Department concludes that serious questions remain concerning the accuracy of SBC's wholesale billing. The record does not permit the Department to conclude that these concerns are insignificant or that they have been adequately addressed. Thus, the Department is not in a position to support SBC's application based on the current record. The Department recognizes that the Commission may have additional evidence at the time it completes its review, and that the Commission may then be able to determine that SBC's billing performance is adequate.
Some CLECs argue that they are often forced to rely on manual processes instead of SBC's normal mechanized interfaces. The largest category of these instances(61) involves software problems in SBC's systems that cause orders to be rejected erroneously; consequently, until the problem is fixed, CLECs must bypass SBC's electronic interfaces and submit affected orders manually by fax.(62) Each time this occurs, CLECs argue, they and their customers are adversely affected during the weeks until that problem is fixed.(63) The nature and number of the software problems alleged indicate that SBC's software testing may be inadequate. Due to time limitations and the changing status of these issues, the Department has not been able to resolve all factual questions surrounding these issues. Given the importance of mechanized interfaces, the Department believes that the Commission should carefully consider the status of any such problems and, more generally, the adequacy of SBC's pre-release testing and defect resolution processes.
As the Department observed in its Michigan III Evaluation, line-splitting service to CLECs could provide an important platform for future broadband competition.(64) The Department, after reviewing SBC's line-splitting services, expressed concern about SBC's processes for reconverting a customer from line-splitting back to UNE-platform service, concluding that the inability of SBC to allow CLECs to re-use loops may place CLECs at a competitive disadvantage as against SBC when they seek to sell DSL service.(65) SBC's policy is the same in each of the four states for which SBC has submitted the application pending before the Commission, and CLECs continue to raise these concerns.(66) Therefore, for the same reasons discussed in its Michigan III Evaluation, the Department believes that the Commission should determine whether SBC's processes provide non-discriminatory access to line-splitting and UNE-platform services.
Prices for unbundled elements must lie within a range consistent with TELRIC principles. Commission rules leave the setting of prices within this range to the state commissions. Z-Tel asserts that SBC will not make available to it state commission-ordered rates in Indiana and Illinois unless Z-Tel agrees to amend its interconnection agreements with SBC.(67) SBC has demanded, Z-Tel alleges, the amendment or insertion of other, unrelated provisions of the interconnection agreement (e.g., a prohibition on retroactive application of cost-based rates) as a condition of amending the pricing provision.(68) Z-Tel apparently has refused to agree to these additional provisions. The Department defers to the Commission's determination whether SBC's conduct could violate Commission rules or provisions of the Telecommunications Act.(69)
As the Department has repeatedly emphasized, performance metrics must be reliable meaningful, accurate, and reproducible if they are to fulfill their dual purposes of depicting an incumbent's present level of performance and of establishing performance benchmarks that enable regulators to detect "back-sliding" and constrain anticompetitive behavior effectively.(70) In this proceeding, the reliability of SBC's reported metrics is again being contested.(71)
The key issues here are the same as the key issues in the pending Michigan application: the status of the ongoing state commission-initiated BearingPoint audit,(72) the scope of the SBC-initiated Ernst & Young ("E&Y") review,(73) and the conclusions that should be drawn from each. After examining these issues in Michigan, and as explained more fully in its Michigan III Evaluation, the Department concluded that the BearingPoint metrics audit and its findings to date should not be ignored or minimized simply because the audit is not progressing as fast as SBC desires, and that weight should be given to the E&Y verification and its conclusions commensurate with its more limited scope and methodology.(74) The record here provides further support for those conclusions,(75) and these matters continue to warrant the Commission's attention.
Overall, the Commission should ensure that the current performance metrics are reliable and that a stable and reliable reporting system will be in place to help ensure that these local markets remain open after SBC's application is ultimately granted. In making these determinations, the Commission should carefully consider BearingPoint's ongoing audits, including its open exceptions, its interim status reports, and any other findings to date regarding the meaningfulness, accuracy, and reproducibility of SBC's reported metrics. The Commission should also consider E&Y's findings, though it should use great care before dismissing, based solely on such findings, problems identified by BearingPoint or indicated by marketplace performance data.
Because serious issues remain concerning SBC's ability to render accurate wholesale bills, the Department is not in a position to support SBC's application based on the current record. The Department does not, however, foreclose the possibility that the Commission may be able to satisfy itself regarding these issues prior to the conclusion of its review.
I hereby certify that I have caused a true and accurate copy of the foregoing Evaluation of the United States Department of Justice to be served on the persons indicated on the attached service list by first class mail, overnight mail, hand delivery, or electronic mail on August 26, 2003.
1. Pub. L. No. 104-104, 110 Stat. 56 (1996) (codified as amended in scattered sections of 47 U.S.C.).
2. See generally DOJ Michigan III Evaluation (filed July 16, 2003). SBC withdrew the third such application, filed on January 16, 2003. SBC Michigan Withdrawal Ex Parte at 1. On February 26, 2003, the Department submitted its Evaluation of that earlier application, focusing on issues pertaining to the adequacy of SBC's operations support systems ("OSS") and change management processes, and the reliability of its performance data. DOJ Michigan II Evaluation at 6-16. Based on these concerns, the Department concluded that it could not "support this application based on the current record." Id. at 16. Following SBC's withdrawal of its application, the Chairman of the Commission stated that "the outstanding issues that prevented approval were very narrow, but nonetheless important." FCC Chairman Powell Michigan Withdrawal Statement at 1. The Chairman noted that "perhaps the most troubling of these issues relates to billing. Despite extensive examination of the record . . . questions remain regarding whether SBC is currently providing wholesale billing functions for competitive LECs in a manner that meets the requirements of our existing precedent." Id.
This Evaluation incorporates by reference the entire DOJ Michigan II and Michigan III evaluations.
3. DOJ Michigan III Evaluation at 3-15.
4. Id. at 8-9, 15.
5. Id. at 15.
6. See DOJ Oklahoma I Evaluation at vi-vii, 36-51.
7. Illinois CC Consultative Report at 5.
8. Id. at 55. On May 9, 2003 the Illinois General Assembly passed Illinois Public Act 93-0005, which dictated how the Illinois CC would consider the fill factor and depreciation inputs in establishing TELRIC costs and rates for UNE loops. As a result, the Illinois CC established new UNE loop rates on June 9, 2003. SBC Wardin Aff. ¶¶ 25-26. The same day, a federal court enjoined the Illinois CC and SBC from implementing the new rates and subsequently issued permanent injunctive relief. Id. ¶ 27. SBC has appealed this order. Id. ¶ 27 n.44. Therefore, the UNE loop rates relied upon by SBC for the purposes of this application are not affected by the new legislation. Id. ¶ 27.
9. Illinois CC Final Order at 829, 916.
10. Id. at 926. The Commission's Final Order dictated certain remedial actions to address deficiencies pertaining to compliance with checklist items 2 and 4, the majority of which SBC has taken. Illinois CC Consultative Report at 4-5.
11. Id. at 4.
12. Indiana URC Comments at 2.
13. Indiana URC Report and Recommendation at 57.
14. Id. at 200. Implementation of the Indiana URC's initial remedy plan was enjoined by a federal court, which found that the state commission had no authority to impose a remedy plan in the context of its Section 271 proceeding. Subsequently, the Indiana URC decided that it would recommend approval of the SBC Indiana Section 271 Remedy Plan, which was based on certain modifications to the Compromise Plan as reflected in Time Warner's interconnection agreement. See id. at 187-88.
15. Indiana URC Comments at 1.
16. Id. at 1-2. In a July 2, 2003 order, the Indiana Commission declined to make a finding regarding SBC's Section 271 compliance until SBC filed certain compliance and improvement plans that had been filed before the Michigan PSC. Indiana URC Compliance Order at 12; see also id. Attach. 1 at 1-5. SBC filed these plans on July 11, 2003 and filed revised versions on August 1. Indiana URC Report and Recommendation at 192-93. These plans notwithstanding, the Indiana URC deferred a number of issues regarding billing, OSS, Change Management/Joint Test Environment, and performance data to the FCC for resolution and asked that the FCC assure enforcement of the proposed remedy plan. See id. at 200.
17. Ohio PUC Report and Evaluation at 2-4.
18. Id. at 153.
19. Id. at 287. The Ohio PUC declined to alter the Ohio remedy plan in its Section 271 proceeding, but decided to open a new docket to consider revisions to the plan to ensure an appropriate level of wholesale performance after Section 271 authority is granted. Id. at 288. Further, the Ohio PUC noted that CLECs may choose to negotiate separate remedy plan terms in the context of an interconnection agreement. Id.
20. Ohio PUC Comments at 1; Ohio PUC Report and Evaluation at 289. The Ohio PUC noted that there were several outstanding OSS functionality issues that, however, did not affect its final decision. In a separate order, the Ohio PUC required that SBC file a compliance plan to address these issues and reinforce the Ohio PUC's protections against backsliding. Ohio PUC Compliance Order at 6-7. SBC filed this plan on July 2, 2003. SBC Br. at 10.
21. Ohio PUC Comments at 5; Ohio PUC Report and Evaluation at 289.
22. Wisconsin PSC Phase I OSS Order at 30.
23. See id.
24. Wisconsin PSC Final Determination II App. B at 1.
25. Wisconsin PSC Final Determination II at 30. SBC sought judicial review of the Wisconsin PSC's initial remedy plan, which was vacated by a state court in July 2002. SBC VanderSanden Aff. ¶ 37. The Wisconsin PSC continues to support this remedy plan, but acknowledges that the existence of the Compromise Plan in interconnection agreements, along with the provisions of the Consent Order, would be sufficient to ensure an appropriate level of wholesale performance after Section 271 authority is granted. Wisconsin PSC Final Determination II at 30.
26. See Wisconsin PSC Comments at 1. The Wisconsin PSC predicated this finding on the requirement that SBC stipulate to an enforceable Consent Order, which required SBC to file nine compliance and improvement plans that ensure the Wisconsin PSC's oversight of SBC's performance in the future. Wisconsin PSC Final Determination II at 22-25. In addition, although the Wisconsin PSC found SBC's billing systems to be checklist compliant, it opened a separate docket to address the continued concerns of the CLECs regarding billing disputes. SBC VanderSanden Aff. ¶ 22.
27. Wisconsin PSC Comments at 1.
28. See DOJ Pennsylvania Evaluation at 3-4 ("The Department first looks to actual competitive entry, because the experience of competitors seeking to enter a market can provide highly probative evidence about the presence or absence of artificial barriers to entry. Of course, entry barriers can differ by types of customers or geographic areas within a state, so the Department looks for evidence relevant to each market in a state." (Footnote omitted.)).
29. See, e.g., DOJ Georgia/Louisiana I Evaluation at 7; DOJ Missouri I Evaluation at 6-7.
30. See SBC Heritage Illinois Aff. at 6 n.9 & tbl.1, Attach. E at 1, 2, 6 (line counts as of May 2003); SBC Heritage Indiana Aff. at 6 n.7 & tbl.1, Attach. E at 1, 2, 6-7 (same); SBC Heritage Ohio Aff. at 6 n.9 & tbl.1, Attach. E at 1, 2, 6 (same); SBC Heritage Wisconsin Aff. at 6 n.8 & tbl.1, & Attach. E at 1, 2, 6 (same). The second three categories report CLEC lines as percentages of total lines, business lines, and residential lines, respectively; the last six categories report percentages of business and residential lines served by CLECs by means of each mode of entry, i.e., facilities-based (service via primarily a CLEC's own network that is either connected directly to the customer premises or connected through loops leased from the BOC), UNE-platform (a combination of loop, switch, and transport elements), and resale.
31. Figures report total lines in SBC's service area in each state. There are incumbent local exchange carriers other than SBC serving parts of Illinois, Indiana, Ohio, and Wisconsin.
32. SBC asserts that its OSS is regional in nature. See, e.g., SBC Br. at 54-55.
33. AT&T also raises an issue that concerns whether it is "effectively unable to send a subsequent change order on the customer's account until it receives" a billing completion notice ("BCN"). AT&T Comments at 65. AT&T argues that the time for posting of the BCN can be lengthy, as long as 10 days. Id. at 66-67; AT&T DeYoung/Willard Decl. ¶ 61. AT&T's inability to submit subsequent change orders, it asserts, can lead to rejected change requests, delayed change provisioning, and customer dissatisfaction. Id. at 65-67. Forte cites similar issues concerning BCNs. Forte Comments at 9-11. Forte states that while using previous Local Service Order Guidelines ("LSOG") versions it was usually able to send subsequent orders within 24 hours of the initial order, whereas now it must wait 24 to 72 hours to send subsequent orders. Id. at 10.
SBC responds that in the case of UNE-platform migrations, a CLEC may submit subsequent change orders once the customer service information ("CSI") has been updated to reflect the CLEC as the owner of the account. SBC Billing Completion Notice Ex Parte at 1. SBC further avers that, "[i]n most cases," the CSI is updated in the ACIS database within 24 hours of a service order completion. Id. SBC also states that for full migrations, "SBC's electronic systems and manual processes are designed to process" change orders even before the CSI is updated. Id. Similar functionality, SBC reports, will be implemented for partial migrations on August 27, 2003. Id. The Commission should assure itself that SBC has adequately addressed the CLECs' concerns.
34. See SBC Brown/Cottrell/Flynn Aff. ¶ 1 n.1.
35. DOJ Michigan III Evaluation at 5-6.
36. See id. at 8.
37. See id. at 7-8.
38. AT&T DeYoung/Tavares Decl. ¶¶ 10-33; MCI Comments at 6-10; TDS Metrocom Comments at 12-14.
39. CIMCO states that it has been assessed non-recurring charges ("NRCs") on lines that it has converted from resale to UNE-platform, experienced double-billing for the same item on different pages of the same invoice, been charged for taxes on non-taxable items, received overcharges for directory assistance (resulting in credits of $15,000 on CIMCO's April bill), and received bills for lines that do not belong to it. CIMCO Comments at 6-7. CIMCO also asserts that SBC has billed the wrong rate for point-to-point circuits, erroneously billed for installation charges on three-year leased circuits, and failed to update CIMCO's customers' PICs in its switch, in one instance resulting in $15,000 in overcharges to a CIMCO customer. Id. at 6-7. Forte complains that it has been assessed erroneous NRCs on lines converted from resale to UNE-platform, experienced double-billing for the same item on different pages of the same invoice, received overcharges for installation on converted lines, and experienced the application of incorrect rates. Forte Comments at 11-12.
NTD complains of "significant problems with SBC's wholesale billing[.]" NTD Comments at 3-4. Among the problems it cites are substantial back-billing for various products and services, billing for products or services that are not provided, double-billing, application of incorrect rates, failure to implement price changes on a timely basis, improper application of payments, and failure to provide back-up data to support billing adjustments. NTD Comments at 3-4. Mpower alleges that SBC erroneously bills it for termination of local, Section 251(b)(5) traffic as well as improper trip charges for hot-cuts. Joint CLEC Comments at 5-6. Access One raises a litany of billing problems, including incorrect universal service order codes, inapplicable local number portability charges, call records for orders that may belong to another CLEC, and unauthorized calls. Access One Comments at 2-3.
AT&T also raises a new issue with respect to UNE-platform billing on non-fieldwork orders. According to AT&T, SBC has been improperly charging new installation NRCs on certain non-fieldwork UNE-platform orders. AT&T DeYoung/Tavares Decl. ¶ 26. In April and May 2003, AT&T reports that it was improperly assessed NRCs on non-field work UNE-platform orders, resulting in over-billing of almost $235,000 in Illinois, Ohio, and Michigan. Id.
40. Forte Comments at 11.
41. TDS Metrocom Comments at 12.
43. Indiana URC Report and Recommendation at 160.
45. Wisconsin PSC Wholesale Billing Practices Notice.
46. See MCI Comments at 9; NTD Comments Ex. 2.
47. DOJ Michigan III Evaluation at 6-7 (citing FCC Pennsylvania Order ¶ 23). AT&T attests that because of SBC's billing errors it "has no way of knowing, month to month, what its costs are, or whether it is operating profitably." AT&T DeYoung/Tavares Decl. ¶ 32. It goes on to assert that it can "be an effective competitor in a service business with margins as narrow as those for local telephone service" only if it knows, "with precision, what its costs are. That information determines, among other things, the pricing that a competitor can offer its customers, the promotions and packages it can offer new customers, and the level of service and commitment it can make[.]" Id.
48. NTD alleges that it "has been forced to hire an employee dedicated to reviewing SBC bills and disputing billing inaccuracies and improper charges." NTD Comments at 8. TDS Metrocom reports that it employs a team of five individuals who spend 30 percent of their time reviewing SBC bills and disputing charges. TDS Metrocom Comments at 9. TDS Metrocom asserts that it has not experienced anywhere near the same magnitude of billing problems with Qwest as it has with SBC. Id. AT&T similarly reports that its two employees who review SBC bills spend approximately 70 percent of their time on Ameritech region bills, and 30 percent of their time on bills generated in SBC's other two regions. AT&T DeYoung/Tavares Decl. ¶¶ 28-29.
49. NTD alleges that it submitted over 200 claims last year, many of which have taken six (6) months to process and resolve. NTD Comments at 8; see also TDS Metrocom Comments at 15 (asserting that although SBC reportedly admitted to misclassifying lines between business and residential categories, the final resolution in the form of credits to TDS Metrocom's bills has taken more than one year from the date SBC was first notified of the problem); Joint CLEC Comments at 7.
50. SBC Michigan III Supp. Reply Comments at 8; see also SBC Michigan III Brown/Cottrell/Flynn Supp. Reply Aff. ¶ 28 (stating SBC spent "hundreds of hours" reviewing an AT&T complaint).
51. See NTD Comments at 7; TDS Metrocom Comments at 19; AT&T DeYoung/Tavares Decl. ¶ 32; Joint CLEC Comments at 8. NTD asserts that "the receipt of an inaccurate bill from SBC followed many months later by a back-bill for additional charges means any opportunity to recover the wholesale charges from NTD's retail customer is lost either as a matter of customer relations in a competitive marketplace, or because some of the end users who were customers of NTD during the period in question are no longer its customers." NTD Comments at 7. CLECs claim that this problem is compounded by SBC's failure to provide source data to justify the back-bills. NTD Comments at 7; TDS Metrocom Comments at 19-20.
52. "The BOC at all times bears the burden of proof of compliance with Section 271, even if no party challenges its compliance with a particular requirement." FCC Minnesota Order App. C ¶ 5; see also FCC Maryland/Washington, DC/West Virginia Order App. F ¶ 5. Compliance with Section 271 requires provision of "complete, accurate and timely wholesale bills." FCC Pennsylvania Order ¶ 13.
53. FCC Pennsylvania Order ¶ 22; see also id. ¶ 15.
54. DOJ Michigan III Evaluation at 7. The Department also noted that the relevant Ameritech region performance metrics have limited utility in catching a wide range of potential billing errors. Id. at 9 n.44. The most relevant metric, MI 14, is designed to determine whether bills are correctly being calculated according to SBC's billing tables, not whether the underlying information about the lines themselves is accurate. Yet bills that are in error because of incorrect information inputs are not less troublesome because that erroneous information was correctly processed. A new metric is being considered, but its content and date of implementation are still uncertain. Id. Some state commissions have also noted these problems. See Indiana URC Report and Recommendation at 158-60; Wisconsin PSC Final Determination II at 18-21.
Similarly, the BearingPoint tests do not provide a sufficient showing of accurate billing. SBC has in its own filings admitted a series of billing errors, including problems related to its ACIS-CABS conversion which alone resulted in nearly $17 million in billing adjustments. See infra notes 58 & 59; see also DOJ Michigan III Evaluation at 8; DOJ Michigan II Evaluation at 10-11 & nn.46-47. BearingPoint apparently did not identify these errors, either because they resulted from causes not detected by the test transactions or because system changes were made after testing activity finished. For such reasons the Department and the Commission have consistently taken the position that data from actual commercial usage is more probative than that from third-party testing, and thus that a successful test is not determinative when commercial usage indicates that significant problems remain. See, e.g., FCC Qwest Multistate I Order ¶ 102; FCC Pennsylvania Order ¶¶ 24, 33; FCC Michigan Order ¶ 138; see also DOJ Michigan III Evaluation at 5.
55. SBC again proffers in its four-state application a comparison of the percentage of wholesale billing disputes as against the percentage of such disputes in states in which SBC has already received Section 271 approval. SBC Brown/Cottrell/Flynn Aff. ¶¶ 130-31. This comparison is not probative as to the issue of billing errors, and the percentage figure is flawed. See DOJ Michigan III Evaluation at 7 n.39. SBC's showing is insufficient, among other reasons, because it (1) apparently does not include billing disputes by AT&T, see SBC Michigan III Brown/Cottrell/Flynn Supp. Reply Aff. ¶ 58, perhaps the largest CLEC; (2) apparently captures only amounts that have been formally disputed, and not those caught by SBC or by the CLEC itself and resolved without a formal dispute, see DOJ Michigan III Evaluation at 7-8 n.39; (3) covers the whole of a 17-month period, SBC Brown/Cottrell/Flynn Aff. ¶ 130, and is not broken down by month so that any trend may be discerned, cf. FCC Pennsylvania Order ¶ 26 (examining dispute data month by month to discern a favorable trend); and (4) compares billing disputes in the four states at issue in this application with current billing disputes in other states in which SBC has already been granted Section 271 authority, SBC Brown/Cottrell/Flynn Aff. ¶ 132, rather than with disputes in those states, or other states, at the time their applications were pending.
56. See, e.g., SBC Michigan III Brown/Cottrell/Flynn Supp. Reply Aff. ¶¶ 25-28, 39-47, 83-101 (discussing contentions about billing made by AT&T, MCI, TDS Metrocom, and other parties). In addition, SBC contests AT&T's assertion about the extent of billing errors it has encountered. Id. ¶ 26. Specifically, SBC alleges, based on a preliminary analysis, that roughly 75 percent of AT&T's asserted errors are due to faulty AT&T record-keeping. Id. A confidential ex parte filed by SBC one week later, however, contains statements in which SBC itself appears to call into question the attribution of all of these errors to AT&T. See SBC Michigan III Billing Ex Parte & Attach. 1 (confidential); see also AT&T DeYoung/Tavares Decl. ¶¶ 13-16 (disputing much of SBC's analysis).
57. SBC Michigan III Brown/Cottrell/Flynn Supp. Reply Aff. ¶ 65.
58. See id. ¶ 27 ("SBC Midwest has identified some errors that are attributable to SBC Midwest; generally speaking, however, these errors appear to be the result of manual service order errors . . . (e.g., exclusion of an accurate telephone number within a FOC/Service Order Completion ("SOC") or an account being established with the incorrect CLEC for the telephone number through a manual error in the service order process)."), ¶ 85 ("MCI has also raised issues with charges related to migrations, disconnects and truck rolls. Based on SBC Midwest's investigation, SBC Midwest has agreed to provide MCI credits related to these items. These issues are largely related to human errors[.]" (footnote omitted)), ¶ 95 ("TDS was mistakenly charged for some DS3 lines because the Trunk Inventory Record Keeping Systems ("TIRKS") was not updated to reflect which circuits were joint circuits. It is important to note that this was an error in updating the TIRKS database, and does not raise issues with SBC Midwest's billing OSS."), ¶ 96 (In addressing TDS's claimed overcharges for the design and construction of collocation facilities, SBC admits that it "mistakenly only adjusted the late payment charges, monthly recurring mileage charges and some non-recurring charges, omitting some of the non-recurring charge adjustments due TDS."), ¶ 97 ("SBC Midwest recently identified that rate updates for Transit billing were not implemented for TDS in Illinois."); see also SBC Brown/Cottrell/Flynn Aff. ¶¶ 105-10 (describing SBC loop rate zone errors), ¶¶ 119-23 (describing SBC misclassification of business and residential loops).
59. See SBC Michigan III Brown/Cottrell/Flynn Supp. Reply Aff. ¶ 101 ("As the result of investigating a recent CLEC billing claim, SBC has determined that approximately 1400 UNE-P circuits across SBC's five Midwest states have been billed incorrectly due to an ordering system error introduced with the March 2003 OSS release. . . . As a result of its finding, SBC will implement a correction on August 1, 2003, to resolve this problem prospectively.").
60. Id. ¶¶ 83, 85.
61. An additional instance involves certain new service orders that had been fully automated but now have a significant manual element. Under LSOG 4, CLECs could electronically submit these orders with a "placeholder" for certain fields where SBC would provide the necessary information and then process the order without further CLEC intervention. SBC Complex Orders Ex Parte at 1-2. Because placeholders were eliminated beginning with LSOG 5, CLECs must first obtain the corresponding information through manual pre-ordering requests that require CLECs to fax lengthy forms to SBC. CIMCO Comments at 4-5 (noting doubling of days involved in the ordering process). It is disputed whether this change was agreed to during the Uniform and Enhanced Plan of Record discussions. Compare SBC Complex Orders Ex Parte at 2, with CIMCO Comments at 4 n.2. SBC has offered to simplify the fax process, SBC Complex Orders Ex Parte at 2; see also CIMCO Comments at 5, but it apparently has no plans to provide an alternative mechanized process that would eliminate the disadvantages of the current manual process.
62. See CIMCO Comments at 3, 8-12; Access One Comments at 5-6; see also Forte Comments at 7-9 (loss of LSOG 4 "unreject" capability increases need for manual faxing). Such problems are ultimately worked via Defect Reports or Change Requests. Given the importance of mechanized ordering, all such problems need to be resolved as expeditiously as possible, regardless of their classification.
63. See Access One Comments at 7 (citing more than $172,000 in lost revenues and personnel costs); CIMCO Comments at 3, 8 (asserting contract orders delayed "for weeks at a time"), 12 (citing lost revenue and personnel costs); Forte Comments at 8, 9 (noting customer could face installation delays of two weeks or more); Joint CLEC Comments at 24-29 (describing effects on CLECs). SBC suggests that CLEC deployment and use of fax servers can reduce the effort of faxing, see SBC Complex Orders Ex Parte at 2 n.1, but this poses a duplicative expense for CLECs that already have incurred the cost of deploying mechanized systems that interconnect with SBC's electronic interfaces.
64. DOJ Michigan III Evaluation at 10. Line-splitting is a configuration of the loop in the central office that permits a CLEC to offer a DSL Internet access service over the same loop that it or another CLEC uses to provide a customer with voice service. This configuration provides an opportunity for CLECs to achieve the same efficiencies that the incumbents have when they offer their voice customers DSL service, avoiding the cost and inconvenience of provisioning a second loop. Such a platform will become more important if in the future incumbent local exchange providers are no longer required to share their voice customer loops with independent providers of DSL service. In such an environment, and absent line-splitting service, a given area might be served only by two broadband providers, the incumbent local exchange provider itself and any cable television system serving the same area.
65. DOJ Michigan III Evaluation at 11-12.
66. See, e.g., AT&T Comments at 11-12.
67. Z-Tel Comments at 6. In Indiana, for example, Z-Tel reports that it is being charged the interconnection agreement rate of $5.34, as opposed to the TELRIC rate of $2.98, for analog switch ports. Id. at 5. Z-Tel alleges that for July 2003 "SBC assessed on Z-Tel more than $47,000 in fees over SBC's TELRIC rates, which equates to approximately 24% of total billed charges to Z-Tel in Indiana." Id. at 10. In Illinois, Z-Tel alleges that SBC charged it more than $157,000 above the TELRIC rates set by the Illinois Commission for July, amounting to over 20 percent of Z-Tel's total billed charges in Illinois. Id. at 9-10.
However, SBC asserts that in Illinois "any CLEC with an existing interconnection agreement may also take service under the terms, conditions, and rate applications contained in Illinois Bell's combination tariff." SBC Br. at 47.
68. Z-Tel Comments at 6-9.
69. See 47 C.F.R. § 51.501 et seq. (2002); 47 U.S.C. §§ 252(d)(1), 252(i), 271(c)(2)(B)(ii).
Another pricing issue is raised by Globalcom, which argues that it is being assessed non-recurring charges ("NRCs") in excess of TELRIC rates for enhanced extended links ("EELs") in Illinois, and that SBC's EELs rate for Wisconsin also fails to be TELRIC compliant. Globalcom Comments at 1-2, 4-9, 24-25. Globalcom states that the rates for Wisconsin have not been, and are not scheduled to be, reviewed by the Wisconsin PSC. Id. at 24-25. The Illinois NRCs for EELs are designated as interim ones. Id. at 9. SBC proposed permanent NRCs for EELs in Illinois which would be substantially lower than the interim ones, although Globalcom argues that these proposed rates were also in excess of TELRIC. Id. at 12-13. The Illinois CC's proceeding to consider the new rates was dismissed, pursuant to a Public Act which itself has been stayed pending ensuing federal litigation. Illinois CC Notice of Action; see also SBC Br. at 48-49; Globalcom Comments at 12. The Department notes that if rates, interim or otherwise, are subject to an established "true-up" provision dating back to a date certain, and where a state commission is committed to establishing appropriately cost-based prices for the elements in question, these issues may best be handled in state commission proceedings. The Department brings this issue to the Commission's attention, and defers to the Commission as to how this question should be resolved.
70. See, e.g., DOJ Oklahoma I Evaluation at 46-48; DOJ Texas I Evaluation at 5-6 (stating that "[i]n evaluating the actual commercial experience of [a Bell company's] competitors . . . the reliability of the reported [performance] data is critical" and discussing the key attributes of reliable metrics); see also DOJ Massachusetts II Evaluation at 4-5; DOJ Performance Measures Reply Comments at 2-4.
71. CLECs argue that the incomplete nature of the BearingPoint audit, along with its findings to date, poses fatal problems, and they de-emphasize E&Y's conclusions due to SBC's sponsorship and the narrower scope of review. See Joint CLEC Comments at 12-14; AT&T Comments at 68-85; TDS Metrocom Comments at 4-8. The Indiana and Ohio consumers' counsels take similar positions. See Indiana OUCC Comments at 7-14; Ohio CC Comments at 5-8, 12-13. In contrast, SBC seeks to distance itself from the BearingPoint audit and relies primarily upon the E&Y review and its conclusions. See, e.g., SBC Br. at 20-23; SBC Ehr/Fioretti Aff. ¶¶ 8, 33-34.
72. The OSS testing established in the four states includes comprehensive performance measures audits conducted by BearingPoint. See, e.g., Illinois CC Consultative Report at 5-6, 7; Indiana URC Report and Recommendation at 1; Ohio PUC Report and Evaluation at 3, 7-8; Wisconsin PSC Final Determination II at 13-14 & nn.22-24. Last year, in the midst of extensive delays in these audits, SBC took the unusual step of asking the Illinois CC to have the BearingPoint testing essentially halted. See SBC Illinois Reply to KPMG Interim Report at 4. SBC sought to halt BearingPoint's testing, citing extensive delay, in the same time-frame that it was finishing its production to BearingPoint of documentation regarding definitions, business rules, and calculations for its metrics, documentation without which BearingPoint could not set up systems to replicate SBC's metrics pursuant to PMR-5 of the test. See Michigan PSC Report at 16-17 & n.37 (discussing extended delay in SBC production of documentation and the resulting impact in terms of delay to the PMR-4 and PMR-5 portions of the testing).
73. SBC initiated its own review, engaging E&Y, its financial auditor, to perform a faster metrics review. E.g., SBC Indiana Intent to File Supplementing Information at 1-3; SBC Ohio Intent to File Supplementing Information at 1-3. In these filings, SBC disclaimed any intent to substitute the E&Y review for the BearingPoint testing, SBC Indiana Intent to File Supplementing Information at 2; SBC Ohio Intent to File Supplementing Information at 2, but that is the practical effect, see SBC Ehr/Fioretti Aff. ¶ 8 (asserting the E&Y review is "the relevant third party evaluation upon which [the FCC] should rely").
74. DOJ Michigan III Evaluation at 13-14. As to the BearingPoint audit, the Department explained that SBC itself appears to be responsible for some of the delays in completion of BearingPoint's audit, and it should not be permitted to bootstrap its position by citing the incomplete nature of the audit as grounds for downplaying the audit's findings to date. Id. at 13 & n.63; see also Indiana URC Report and Recommendation at 160 (agreeing with DOJ analysis).
75. For example, like the Department, the Indiana URC and Ohio PUC explicitly recognize that the E&Y review has a more limited scope than the BearingPoint audit and that this limits the weight that should be accorded its conclusions. Ohio PUC Report and Evaluation App. A at 27-28 (determining that it would not rely on E&Y results). Further, the Illinois Commission found that "a 'Not Satisfied' finding indicates failure until such time as the third party can verify the Company has addressed the concerns or findings that resulted in the Not Satisfied finding." Illinois CC Final Order at 766. Thus, such BearingPoint findings have evidentiary value for as long as a criterion remains unsatisfied. See SBC Michigan III Ehr/Fioretti Supp. Reply Aff. Attach. B at 2-3 (BearingPoint e-mail). The Indiana URC found that BearingPoint "has uncovered significant questions about the reliability of SBC's performance measures results, the integrity of the underlying data, and the adequacy of SBC's various performance measure systems and the controls," and although some problems appear to have been corrected, "BearingPoint continues to report significant metrics-related problems." Indiana URC Report and Recommendation at 33, 34. At this point, approximately 25 percent of applicable metrics test criteria are "Not Satisfied." See AT&T Moore/Connolly Decl. at 36-38 tbls. 1-4 (reproducing test statistics from recent BearingPoint reports). Further, by AT&T's analysis, nearly 60 percent of SBC's measures are affected by documentation errors. AT&T Moore/Connolly Decl. ¶ 111. AT&T argues that the current percentage of criteria "passed" by SBC in these states is much lower than in states as to which the Commission has granted Section 271 applications. AT&T Comments at 73; AT&T Moore/Connolly Decl. ¶¶ 77-84.