Drop/filter out rows containing nulls at the schema level
              
              #17034
            
            
              
                Unanswered
              
          
                  
                    
                      90degs2infty
                    
                  
                
                  asked this question in
                Q&A
              
            Replies: 0 comments
  
    Sign up for free
    to join this conversation on GitHub.
    Already have an account?
    Sign in to comment
  
        
    
Uh oh!
There was an error while loading. Please reload this page.
-
Hello everyone!
Is there a way to
DataFramecontainingnulls in a set of selected columns while at the same timeDataFrame's schema about the fact that the set of selected columns cannot contain physicalnulls afterwards? I.e. I'd likeis_nullableto returnfalsefor the respectiveFields after dropping (similar to whatfill_nulldoes).One can easily achieve 1. by passing a suitable
Exprtofilter. However, I don't know how to implement 2. Any thoughts? Thank you very much! 🙏Beta Was this translation helpful? Give feedback.
All reactions