SQL Reference

Spark SQL is Apache Spark's module for working with structured data. This guide is a reference for Structured Query Language (SQL) and includes syntax, semantics, keywords, and examples for common SQL usage. It contains information for the following topics:

• ANSI Compliance
• Data Types
• Datetime Pattern
• Number Pattern
• Operators
• Functions
  • Built-in Functions
  • Scalar User-Defined Functions (UDFs)
  • User-Defined Aggregate Functions (UDAFs)
  • Integration with Hive UDFs/UDAFs/UDTFs
  • Function Invocation
• Identifiers
• IDENTIFIER clause
• Literals
• Null Semantics
• Name Resolution
• SQL Scripting
• SQL Syntax
  • DDL Statements
  • DML Statements
  • Data Retrieval Statements
  • SQL Scripting Statements
  • Auxiliary Statements
  • Pipe Syntax