In general, in order to deduct points paid in connection with a residential mortgage, the points must be "qualified residence interest." In addition, even where points are deductible, certain other requirements, as discussed below, must be satisfied in order to deduct them in the year they are paid (as opposed to being written off over the term of the mortgage).
In order for interest (including points) paid in connection with a refinancing mortgage to be "qualified residence interest," the mortgage must be with respect to, and secured by, either your principal residence or one second residence which you select. In addition, the mortgage proceeds must either be used to make substantial improvements to the home, or must not exceed the principal amount of your old mortgage by more than $100,000 ($50,000 if you are married and file a separate return).
Even where "points" paid on a refinancing are "qualified residence interest," they will only be deductible in the year paid