Showing posts with label cyclone forecast. Show all posts
Showing posts with label cyclone forecast. Show all posts

Tuesday, August 1, 2017

Another cyclone forecast BOMs out

A characteristic of ABC News is it's lack of inquiry in testing the outcomes of predictions on climatic events made by experts. One would think that the outcome of predictions would be newsworthy given the amount of money the government allocates to our premier weather agency.

The Bureau of Meteorology annually release an outlook of the coming tropical cyclone season in Spring. We have previously  looked at the accuracy of BOM's cyclone forecasts and ABC's reluctance to cover the disparity between forecast and outcomes, but have not had a chance to follow up on recent pronouncements.

Looking at the 2016-2017 season last year ABC reported that "Weather forecasters are expecting an average to above-average number of tropical cyclones to form this season in the region that includes the Northern Territory."

BOM claimed with a "high" level of accuracy :

  • The Australian region has a 67% chance of having more tropical cyclones than average, meaning a 33% chance of having fewer tropical cyclones than average. Typically, around four tropical cyclones cross the Australian coastline in a season. Outlook accuracy for the Australian region is high.

So what was the outcome? It seems BOM no longer produce the Darwin Tropical Diagnostic Statement that provided a near real time summary of cyclone activity. Perhaps its buried somewhere else in it's labyrinthine web page. However Wikipedia produce a season summary:  

Once again the numbers paint a poor picture of BOM's cyclone forecast skill, but ABC don't think this is newsworthy.

Saturday, June 2, 2012

Cyclone forecast a BOM - Part 2

Cyclone tracks in Australia region July 2010-June 2011 (11 tropical cyclones in total)

Abstract
BOM's 2010-2011 tropical cyclone forecast: 20-22 cyclones forecast with a high level of confidence.
BOM Summary: Above average tropical cyclone activity expected for the Australian region  (98% chance!)
Season outcome:  11 actual cyclones. 

We previously looked at the BOM's woeful 2011-2012 tropical cyclone forecast.  ABC provided some coverage of the original forecast (Here and Here)  but didn't think it newsworthy to cover the outcome of that forecast. Remember for the 2011-2012 cyclone season Australia's premier meteorological institute predicted an 80% chance that cyclones would exceed the long term average (12). The actual number of cyclones (8) was 33% below the long term average. Missed it by that much!

Looking to see if previous forecasts were any better, we turned our attention to the 2010-2011 season. This covered the time interval July 2010 to June 2011.

Here was BOM's 2010-2011 forecast (alternate site HERE)

Seasonal Outlook for Tropical Cyclones


Summary: Above average tropical cyclone activity expected for the Australian region
The outlook suggests that the coming tropical cyclone season is likely to have
  • a higher than average number of tropical cyclones over the full Australian region,
  • a higher than average number of tropical cyclones in the Western region,
  • an average to above average number of tropical cyclones in the Northern region,
  • a higher than average number of tropical cyclones in the Eastern region.
For the full Australian region, there is a high degree of confidence that the total number of tropical cyclones will be above average (see Table 1). The forecast values from the two models (20-22) are significantly higher than the long-term average value of 12.
Table 1 Forecast values for the 2010/11 Seasonal Outlook for Tropical Cyclones (TCs) for the four main tropical cyclone regions and the northwest WA sub-region (105°E to 130°E).
RegionChance of more TCs than averageLikely number of TCs (average number)Confidence (LEPS skill1)
Australian region98%20-22 (12)High (46%)
Western region93%11-12 (7)High (31%)
Northern region67%5 (4)Low (3%)
Eastern region87%6-7 (4)Moderate (21%)
Northwest WA75%7-8 (6)Low (7%)
The likely number of tropical cyclones is indicative only. It is expected that the total number of tropical cyclones will be in the vicinity of the values listed, and not necessarily within the given range. The values are the most likely number of tropical cyclones forecast by two models.
Regional features
  • The largest increase in tropical cyclone numbers is expected to occur in the Western region, where 11-12 tropical cyclones are forecast (4-5 more than the average value of 7 tropical cyclones).
  • For the Northern region, an average to higher than average number of tropical cyclones is expected with 5 tropical cyclones being forecast (the average value is 4 tropical cyclones). However, as the statistical model used to produce this forecast has low skill in this region, this prediction should be used with some caution.
  • The Eastern region is expected to experience a higher than average number of tropical cyclones, with about 6-7 tropical cyclones being forecast (the average value is 4 tropical cyclones).
  • The outlook for tropical cyclones in the area from 105°E to 130°E, where tropical cyclones can impact upon coastal WA communities, shows a 75% chance of above average tropical cyclone numbers for the 2010/11 season. However, forecast confidence for this region is relatively low.
This outlook covers the period from July 2010 to June 2011. Most tropical cyclones in the Southern Hemisphere occur from November until April.
So how did they go?
The cyclone tracks for season 2010-2011 are overlain on BOM's regional map at the top of the page. These are derived from reports from the Darwin Regional Specialised Meterological Centre (links to monthly reports below). It seems BOM did worse in 2010-2011. For the 2010-2011 cyclone season Australia's premier meteorological institute predicted a 98% chance that cyclones would exceed the long term average (12). The actual number of cyclones (11) was below the long term average. Missed it by that much! Perhaps the media can exhibit a little more scepticism when the next forecast is made. We look forward to the following questions being posed when the next seasonal outlook is made:
So how did your last two seasonal forecasts go? 

Links to monthly BOM reports.
July-September No cyclones in Australian region 
October 2010 1 tropical cyclone in Australia region (5°S-40°S, 90°E-160°E) Anngrek
November 2010 0 tropical cyclone in Australia region (5°S-40°S, 90°E-160°E) 
December 2010 2 tropical cyclone in Australia region (5°S-40°S, 90°E-160°E) Abele, Tasha
January 2011  5 tropical cyclone in Australia region (5°S-40°S, 90°E-160°E) Vince, Bianca, Yasi, Anthony, Zelia
February 2011 2 tropical cyclone in Australia region (5°S-40°S, 90°E-160°E) Carlos, Dianne
March 2011 0 tropical cyclone in Australia region (5°S-40°S, 90°E-160°E) 
April 2011 1  tropical cyclone in Australia region (5°S-40°S, 90°E-160°E) Errol
May-June, 2011 No cyclones in Australian region 

Total cyclones Australia region July 2010-June 2011: 11


Coverage also at Wikipedia: 2010–11 Australian region cyclone season

Sunday, May 20, 2012

Cyclone forecast a BOM

The 2011-2012 cyclone season came to a close in April. In October last year the Bureau of Meteorology issued its forecast for the 2011-2012 season. ABC provided some coverage (Here and Here)  focusing closely on forecasts for NW Australia. Here's BOM's forecast from last year:


2011-12 Australian Tropical Cyclone Season Outlook


Summary: Above average tropical cyclone activity likely for the Australian region this season
The outlook favours the following scenarios for the coming season:
  • The whole Australian Region has an 80% chance of having more than the long-term average number of cyclones. The long-term average is twelve.
  • The Western Region has a 65% chance of observing above average number of tropical cyclones, where the long-term average is seven.
  • The North-western Sub-region has a 60% chance of above average number of tropical cyclones. The long-term average is five.
  • The Northern Region has a 60% chance of above average number of tropical cyclones, where the long-term average is two or three cyclones.
  • The Eastern Region has a 65% chance of observing above average number of tropical cyclones, where the long-term average is three or four.
Table 1 Forecast values for the 2011/12 Seasonal Outlook for Tropical Cyclones (TCs) for the four main tropical cyclone regions and the north western sub-region.
Region
Chance of above average tropical cyclone activity
Long-term average
Forecast skill
Australian region
80%
12
Very high
Western region
65%
7
Moderate
North-western sub-region
60%
5
Moderate
Eastern region
65%
4
Moderate
Northern region
60%
3
Low





BOM forecast the number of cyclones in all regions should have been above the long term average. It rated its forecast skill as "Very High". How did it play out???? Here's a map showing tracks of cyclones affecting the Australian region for the forecast period based on reports by the Darwin Regional Specialised Meterological Centre (links to monthly reports below).
Figure 1 Cyclone tracks for 2011-2012 cyclone season


Here's a summary table for Australia as a whole and each region:



Table 2 Actual cyclone numbers for the 2011/12 Tropical Cyclone Season. 
Region
Difference from (Average)
Reported Cyclone Numbers
Forecast skill
Australian region
-4 (12) 
8
Poor
Western region
-2 (7)
5
Poor
North-western sub-region
-2 (5)
3
Poor
Eastern region
-2 (4)
2
Poor
Northern region
-2 (3)
1
Poor

Links to monthly BOM reports.
Nov 2011 No Cyclones  in Australian region (5°S-40°S, 90°E-160°E) 
Dec 2012 3 Cyclones in Australian region (5°S-40°S, 90°E-160°E) 0 NW region Alenga, Grant, Fina
Jan 2012 2 Cyclones in Australian region (5°S-40°S, 90°E-160°E) 2 NW region HeidiIggy
Feb 2012 1 Cyclone in Australian region (5°S-40°S, 90°E-160°E) 0 NW region Jasmine
March 2012 2 Cyclones  in Australian region (5°S-40°S, 90°E-160°E) 1 NW region Lua, Koji-Joni
April 2012 0 Cyclones  in Australian region (5°S-40°S, 90°E-160°E) 
Total for season: 8 in Australian region (5°S-40°S, 90°E-160°E) 


Seasonal forecasts are news, but the outcome of those forecasts are news also, especially when the forecast skill is so poor. For the 2011-2012 cyclone season Australia's premier meteorological institute predicted an 80% chance that cyclones would exceed the long term average (12). The actual number of cyclones (8) was 33% below the long term average. Missed it by that much!

Wikipedia also have a post HERE with similar numbers.