Monday, Mar 27th

Last updateFri, 24 Mar 2017 3pm

You are here: Home The Community Void the Current Tax Roll? Nottage Debunks Alternative Facts
first
  
last
 
 
start
stop
first
  
last
 
 
start
stop

Void the Current Tax Roll? Nottage Debunks Alternative Facts

homesalesSince Joanne Wallenstein wrote her article with my analysis, I've gotten a lot of feedback, some good suggestions/critiques and some...not so helpful. So I wanted to update and extend some of what I did.

Several people noted it might not be fair to compare the 2016 post BAR/SCAR roll to the same for 2015. One person, Jane Curley, made this case particularly forcefully in a letter to the editor of the Scarsdale Inquirer helpfully titled "Lies, and the Lying Liars Who Tell Them" about six of the 185 sales I included that she thought fell into that category:

Curley said,

"In actuality, only about six of the sales were incorrectly included. However, including them introduces bias into the analysis and that is very, very bad. That said, this happens all the time, usually innocently. However, once something like this is identified, it needs to be acknowledged. When you don't acknowledge it that is the statistical equivalent of a lie."

I'm not a fan of someone implying I'm dishonest, especially when I was fully transparent with the data and when the argument they're making is both so easily tested and so self-evidently unlikely to change any results (6 out of 185. Seriously?). So I redid the analysis with the 2016 tentative roll versus the final roll I'd used previously. You can see the results in the table below. If you're keeping score at home, nothing changed (several commenters pointed out as much to Curley, but in fairness to her, perhaps she was too busy composing her "lying liars" letter to run the numbers). And contra Mayra Kirkendall-Rodriguez's assertion that "Nottage's analysis was not validated nor peer reviewed. Several quants have already discredited his work" no such thing has happened. Statistician Michael Levine said in the last trustees meeting—at which people like Bob Harrison screamed about my "bogus analysis" and complained that my assessment went down—that mine was a valid exercise and that he found similar statistical results (I want to stress that he does not extend his conclusions to saying what roll should be used). It is surprising to me that everyone has had the data for this long and yet no one has come back with substantive quantitative rebuttals.

nottage1

As an aside, I'm further amazed that people think someone's assessment going down is evidence that they're biased. I'm particularly amazed because some of the people making that argument also saw their assessments go down! It would be helpful for someone to make a cheat sheet of when a lowered assessment indicates insuperable bias versus when it indicates selfless public virtue. Asking for a friend.

In the same letter to the editor, Curley tries to explain why the stats may look as they do: "Finally, during the past year or two, the prices of Scarsdale's more modest homes seem to have gone up more significantly than the prices of higher end properties. This is a very happy coincidence that could just as easily have gone the other way."

Sooo... the 2016 roll only looks good because changes in housing market conditions have made it more representative? Well apart from that little fact Mrs. Lincoln, how was the play? I'm no lawyer, but I would hope that the Article 78 plaintiffs don't intend to argue that market reality (sales) has somehow unluckily conspired to make the 2015 roll look less accurate and that looking at prices on the ground today is somehow less relevant than looking at prices in 2013 which the Tyler valuations was derived from (this latter argument has actually been explicitly made). If market forces have moved higher-end homes down and lower end homes up, how would a fair assessment roll not reflect that, you know, kind of important fact?

But I wanted to delve further. Another argument made is that while 2016 may be more accurate, it is biased to high-end homes. That argument is actually right. It is biased. But the Tyler assessments were biased toward lower-end homes. Moreover, both underassess homes between $1.0-3.0M (hence the fact that both rolls would have needed an equalization ratio).

So if we have opposite biases, can we make any conclusions? Here, the inferences get muddier, but it is helpful to run some additional assessment ratios.

Nottage2


In the table above, I calculate the coefficient of dispersion (COD), price-related differential (PRD), and the price-related bias (PRB). All these are calculable from the posted dataset and I've included documents that show the steps in the table footnoted. A key critique of using just the COD and PRD is that they are simplistic and biased. The PRB is the new hot thing that assessor organizations like the IAAO are pushing (NY doesn't require it but some other states do). It measures the percentage change in assessment ratios as values double; a positive number implies overassessment at higher-priced homes and a negative number implies underassessment at higher-priced homes. In the table, I've included acceptable ranges of each from NY ORPTS and IAAO as I understand them.

As with the goodness of fit data, these results surprised me. The 2016 roll "passes" all three, while the 2015 "fails" two of three. Most telling is the PRB as it is constructed to let an assessor quantify how much progressivity or regressivity there is. At least as measured here, the bias toward lower-priced homes in the 2015 roll (9%) is three times larger than the 2016 roll's bias toward higher-priced homes (-3%).

So Tyler overassessed the high-end, Ryan overassessed the low end, both underassessed the middle (most of the village), but the PRB shows Tyler's bias was larger, while the COD shows the Tyler results are less accurate, at least as measured by the last year of sales.

These ratios don't conclusively prove that one roll is more equitable (or rather less unequitable) than the other. But it is surprising how relatively well the 2016 roll comes out, with multiple tests and slices of the data. I did similar analyses for sales just in the last half of 2016 (on the suspicion that Ryan might have somehow seen listings and adjusted his data accordingly). I did the analysis by lopping off the $3M+ range, Tyler's worst. While the absolute numbers changed (as you'd expect), the directional results were remarkably robust.

Why is this the case? I'm not completely sure. I suspect Ryan partly did get lucky: the market moved his way, as it has in all of Westchester County, but that counts. I also think Tyler's comp method introduced volatility relative to the sort of pure market model Ryan used. Tyler also has many more neighborhoods than Ryan leading to more cases of similarly-located homes having wildly different values. Both revals generated hundreds of challenges so each had problems.

But whatever the case, the question before the community is not whether Ryan did a great job or fulfilled his contract. The question is whether the evidence justifies taking the extraordinary measure of voiding an existing assessment roll to go back to one that, as measured by IAAO standards, is less reflective of the current market and which will potentially be even more unfair to a different group of people. I don't think such evidence has been presented. Accordingly, I don't think the village should countenance either rolling back to 2015 or settling with the Article 78 plaintiffs. We should look toward the next revaluation to fix the shortcomings of both Tyler and Ryan.

If you'll indulge me, I'll end on a personal note. The personal and often nasty nature of many of the attacks I've experienced over the past few days in multiple venues has been eye opening. People point to my membership on the CNC as though agreeing to run in a neighborhood election two years ago—a process that hundreds of our neighbors have gone through—somehow makes me the equivalent of a political machine insider. Well I'm no insider (I'd wager none of the trustees know me from Adam), but I'm proud to have served with CNC volunteers whom I hadn't known, but who spent many hours not just selecting candidates but encouraging as broad and diverse a set of people to put themselves up as candidates. I hope that we as a village never reward those who scream the loudest, who seek to pit people against each other the most, and who resort to vicious attacks when challenged.

Brian Nottage, PhD, CFA

Comments   

-1 #18 Conflict of Interest 2017-03-21 12:06
Precisely!

Also, a new reval would be in line with the recent sales data. That sales data shows Ryan valuation is more representative than Tyler. Consequently, a new reval will be closer to Ryan than Tyler.

There is a chance that a new reval may penalize small homes vs larger houses even more than Ryan did (given recent housing trends). So be careful what you wish for....

Quoting To Josh Frankel again:
Mr. Frankel, you may not have read all the way through. Dr. Nottage seems to agree that we should consider another assessment. He says: "we should look toward the next revaluation to fix the shortcomings of both Tyler and Ryan."

What he is opining on is whether they key demand of the Article 78 - that we should go back to 2015 values - has any merit. His analysis shows that it does not.
Quote
+5 #17 To Josh Frankel again 2017-03-21 11:10
Mr. Frankel, you may not have read all the way through. Dr. Nottage seems to agree that we should consider another assessment. He says: "we should look toward the next revaluation to fix the shortcomings of both Tyler and Ryan."

What he is opining on is whether they key demand of the Article 78 - that we should go back to 2015 values - has any merit. His analysis shows that it does not.
Quote
-3 #16 Irony? 2017-03-21 09:43
For the last few months, we poor residents have been constantly lectured and belittled by others with seemingly all-powerful "quantitative" "modeling" and "risk management" skills. If only we would listen to the experts, they say, we wouldn't be in such a mess

Now these so-called experts can't even agree among themselves!
Quote
-3 #15 Josh Frankel 2017-03-21 08:21
I'm happy to have a conversation about blog commenting etiquette with you some other time. It's little more than a distraction, as I'm sure you're aware. I'd prefer to actually discuss the reval.

So, let's be clear about this one *fact*: In its review of Ryan, the State of New York found his work so wanting that it specifically recommended that we "consider another reassessment." If you'd like to opine on the state's letter to the village, by all means have at it. That's a very inconvenient fact for those who want to prop up Ryan, is it not? Let's confine our discussion to that issue for now so as not to lose focus. What say you?

Quoting Conflict of Interest:
Mister Frankel: At least now you agree you did something that you could not recall doing. That is progress.

You have no right to ask for real names. That right belongs only to the site administrator.

You are trying to use aliases as a way to diminish an argument and/or to bully people. If someone uses an alias, they must have their reasons. You are well aware of this and yet you keep asking...

Same is true regarding assessments. You are using Mr. Nottage's assessment going down as a reason to impugn his integrity. And the integrity of anyone who might be even slightly pro-Ryan. It is highly inappropriate.
Quote
+2 #14 Eli Mattioli 2017-03-21 08:03
Dr. Nottage, thank you for your thoughtful, fact-based analysis of the 2016 reval in light of recent sale prices. It is most compelling because a property's tax assessment is supposed to reflect its market value, and as a matter of both appraisal methodology and New York law, a recent sale price is the most important indicator of a property's market value.
Quote
+2 #13 Pam Rubin 2017-03-21 07:15
Thank You for this. I've sent your analysis to many people who have asked about the "reveal issue". Well done. Numbers don't lie.
Quote
-3 #12 Conflict of Interest 2017-03-20 21:38
Mister Frankel: At least now you agree you did something that you could not recall doing. That is progress.

You have no right to ask for real names. That right belongs only to the site administrator.

You are trying to use aliases as a way to diminish an argument and/or to bully people. If someone uses an alias, they must have their reasons. You are well aware of this and yet you keep asking...

Same is true regarding assessments. You are using Mr. Nottage's assessment going down as a reason to impugn his integrity. And the integrity of anyone who might be even slightly pro-Ryan. It is highly inappropriate.
Quote
+4 #11 Madelaine Eppenstein- 2017-03-20 18:47
Thank you Brian for your generous contribution to the community and our civil discourse. I'm proud to serve on the CNC with you.
Quote
+11 #10 Thank you Brian 2017-03-20 15:10
Thank you, Brian, for your insightful analysis. I'm surprised to be saying this, but I now agree that valuations should not be rolled back. I do hope that the process is conducted in a far better way next time.
Quote
-6 #9 Still Josh Frankel 2017-03-20 14:12
Yes, I asked "Wow" if that was his/her real name. Big whoop. That is a question I will ask all day long. There is no reason to use an alias. In fact, I believe a while back Joanne saying she was going to disallow them. Guess that'll never happen. And if being asked your real identity intimidates anyone, well, that's fairly telling.

So you caught these two "attacks" - "Do you live in Scarsdale" and "Did your assessment go up or down, and by how much?" Relevant? Yes. Ad hominem? No. Whether you choose to acknowledge it or not, this information matters. As does Dr. Nottage's affiliation with the CNC, which I see you've quietly dropped.


Quoting Conflict of Interest:
Allow me to refresh your memory:

On March 9 you wrote "Dear wow, is that your real name?"

You know full well why people use aliases on this website. This question is a subtle form of intimidation.

On Aug 21 you wrote "So we're clear: Do you live in Scarsdale? Did your assessment go up or down, and by how much?"

Also, you did not address the fact that you questioned Mr. Nottage's credibility due to his assessment going down.


Quoting Josh Frankel:
We'll have to disagree on the definition of the word "attack." Asking someone to identify him/herself is not an attack. Asking someone if they live in Scarsdale - which I don't even recall having done - is not an attack. Asking someone if their assessment went up or down - which I don't even recall having done, as I usually look it up myself - is not an attack.


Quoting Conflict of Interest:
But Mister Frankel that is not all you did. You also questioned his credibility because his assessment went down.

Ther are numerous instances on this website of you attacking anyone who is even remotely pro-Ryan with the following questions:

1. Is that your real name?
2. Do you even live in scarsdale?
3. Did your assessment go down?

Quoting Josh Frankel:
Okay, I'll bite.

I am of the opinion that Dr. Nottage's CNC affiliation was worthy of disclosure, and have said as much (and did so in a matter of fact way). Conflicts should be disclosed. Even the appearance of impropriety should be avoided. I'm not sure why this is controversial.

All I need to know about the Ryan reval I learned from the State of New York, which said - note the quotation marks - that Scarsdale should "consider another reassessment" (Notice of Tentative State Equalization Rate). The state told us in October what those of us who'd looked at it knew in June. Can we please end this revisionist history?

Quoting Conflict of Interest:
Allow me to refresh your memory:

On March 9 you wrote "Dear wow, is that your real name?"

You know full well why people use aliases on this website. This question is a subtle form of intimidation.

On Aug 21 you wrote "So we're clear: Do you live in Scarsdale? Did your assessment go up or down, and by how much?"

Also, you did not address the fact that you questioned Mr. Nottage's credibility due to his assessment going down.


Quoting Josh Frankel:
We'll have to disagree on the definition of the word "attack." Asking someone to identify him/herself is not an attack. Asking someone if they live in Scarsdale - which I don't even recall having done - is not an attack. Asking someone if their assessment went up or down - which I don't even recall having done, as I usually look it up myself - is not an attack.


Quoting Conflict of Interest:
But Mister Frankel that is not all you did. You also questioned his credibility because his assessment went down.

Ther are numerous instances on this website of you attacking anyone who is even remotely pro-Ryan with the following questions:

1. Is that your real name?
2. Do you even live in scarsdale?
3. Did your assessment go down?

Quoting Josh Frankel:
Okay, I'll bite.

I am of the opinion that Dr. Nottage's CNC affiliation was worthy of disclosure, and have said as much (and did so in a matter of fact way). Conflicts should be disclosed. Even the appearance of impropriety should be avoided. I'm not sure why this is controversial.

All I need to know about the Ryan reval I learned from the State of New York, which said - note the quotation marks - that Scarsdale should "consider another reassessment" (Notice of Tentative State Equalization Rate). The state told us in October what those of us who'd looked at it knew in June. Can we please end this revisionist history?

Quoting Conflict of Interest:
Allow me to refresh your memory:

On March 9 you wrote "Dear wow, is that your real name?"

You know full well why people use aliases on this website. This question is a subtle form of intimidation.

On Aug 21 you wrote "So we're clear: Do you live in Scarsdale? Did your assessment go up or down, and by how much?"

Also, you did not address the fact that you questioned Mr. Nottage's credibility due to his assessment going down.


Quoting Josh Frankel:
We'll have to disagree on the definition of the word "attack." Asking someone to identify him/herself is not an attack. Asking someone if they live in Scarsdale - which I don't even recall having done - is not an attack. Asking someone if their assessment went up or down - which I don't even recall having done, as I usually look it up myself - is not an attack.


Quoting Conflict of Interest:
But Mister Frankel that is not all you did. You also questioned his credibility because his assessment went down.

Ther are numerous instances on this website of you attacking anyone who is even remotely pro-Ryan with the following questions:

1. Is that your real name?
2. Do you even live in scarsdale?
3. Did your assessment go down?

Quoting Josh Frankel:
Okay, I'll bite.

I am of the opinion that Dr. Nottage's CNC affiliation was worthy of disclosure, and have said as much (and did so in a matter of fact way). Conflicts should be disclosed. Even the appearance of impropriety should be avoided. I'm not sure why this is controversial.

All I need to know about the Ryan reval I learned from the State of New York, which said - note the quotation marks - that Scarsdale should "consider another reassessment" (Notice of Tentative State Equalization Rate). The state told us in October what those of us who'd looked at it knew in June. Can we please end this revisionist history?

Quoting Conflict of Interest:
Allow me to refresh your memory:

On March 9 you wrote "Dear wow, is that your real name?"

You know full well why people use aliases on this website. This question is a subtle form of intimidation.

On Aug 21 you wrote "So we're clear: Do you live in Scarsdale? Did your assessment go up or down, and by how much?"

Also, you did not address the fact that you questioned Mr. Nottage's credibility due to his assessment going down.


Quoting Josh Frankel:
We'll have to disagree on the definition of the word "attack." Asking someone to identify him/herself is not an attack. Asking someone if they live in Scarsdale - which I don't even recall having done - is not an attack. Asking someone if their assessment went up or down - which I don't even recall having done, as I usually look it up myself - is not an attack.


Quoting Conflict of Interest:
But Mister Frankel that is not all you did. You also questioned his credibility because his assessment went down.

Ther are numerous instances on this website of you attacking anyone who is even remotely pro-Ryan with the following questions:

1. Is that your real name?
2. Do you even live in scarsdale?
3. Did your assessment go down?

Quoting Josh Frankel:
Okay, I'll bite.

I am of the opinion that Dr. Nottage's CNC affiliation was worthy of disclosure, and have said as much (and did so in a matter of fact way). Conflicts should be disclosed. Even the appearance of impropriety should be avoided. I'm not sure why this is controversial.

All I need to know about the Ryan reval I learned from the State of New York, which said - note the quotation marks - that Scarsdale should "consider another reassessment" (Notice of Tentative State Equalization Rate). The state told us in October what those of us who'd looked at it knew in June. Can we please end this revisionist history?

Quoting Conflict of Interest:
Allow me to refresh your memory:

On March 9 you wrote "Dear wow, is that your real name?"

You know full well why people use aliases on this website. This question is a subtle form of intimidation.

On Aug 21 you wrote "So we're clear: Do you live in Scarsdale? Did your assessment go up or down, and by how much?"

Also, you did not address the fact that you questioned Mr. Nottage's credibility due to his assessment going down.


Quoting Josh Frankel:
We'll have to disagree on the definition of the word "attack." Asking someone to identify him/herself is not an attack. Asking someone if they live in Scarsdale - which I don't even recall having done - is not an attack. Asking someone if their assessment went up or down - which I don't even recall having done, as I usually look it up myself - is not an attack.


Quoting Conflict of Interest:
But Mister Frankel that is not all you did. You also questioned his credibility because his assessment went down.

Ther are numerous instances on this website of you attacking anyone who is even remotely pro-Ryan with the following questions:

1. Is that your real name?
2. Do you even live in scarsdale?
3. Did your assessment go down?

Quoting Josh Frankel:
Okay, I'll bite.

I am of the opinion that Dr. Nottage's CNC affiliation was worthy of disclosure, and have said as much (and did so in a matter of fact way). Conflicts should be disclosed. Even the appearance of impropriety should be avoided. I'm not sure why this is controversial.

All I need to know about the Ryan reval I learned from the State of New York, which said - note the quotation marks - that Scarsdale should "consider another reassessment" (Notice of Tentative State Equalization Rate). The state told us in October what those of us who'd looked at it knew in June. Can we please end this revisionist history?
Quote

Add comment

first
  
last
 
 
start
stop