You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
AttributeError: Can't get attribute 'MissingType' on <module 'jinja2.utils' from '/home/upload/airflow-2.0/local/lib/python3.6/site-packages/jinja2/utils.py'>
#14651
Hi,
When i start the airflow scheduler like: airflow scheduler --do-pickle
Here are some error logs like:
Traceback (most recent call last):
File "/usr/lib64/python3.6/pickle.py", line 269, in _getattribute
obj = getattr(obj, subpath)
AttributeError: module 'jinja2.utils' has no attribute 'MissingType'
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/usr/lib64/python3.6/pickle.py", line 918, in save_global
obj2, parent = _getattribute(module, name)
File "/usr/lib64/python3.6/pickle.py", line 272, in _getattribute
.format(name, obj))
AttributeError: Can't get attribute 'MissingType' on <module 'jinja2.utils' from '/home/upload/airflow-2.0/local/lib/python3.6/site-packages/jinja2/utils.py'>
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/home/upload/airflow-2.0/local/lib64/python3.6/site-packages/sqlalchemy/engine/base.py", line 1204, in _execute_context
context = constructor(dialect, self, conn, *args)
File "/home/upload/airflow-2.0/local/lib64/python3.6/site-packages/sqlalchemy/engine/default.py", line 854, in _init_compiled
param.append(processors[key](compiled_params[key]))
File "/home/upload/airflow-2.0/local/lib64/python3.6/site-packages/sqlalchemy/sql/sqltypes.py", line 1702, in process
value = dumps(value, protocol)
File "/home/upload/airflow-2.0/local/lib/python3.6/site-packages/dill/_dill.py", line 273, in dumps
dump(obj, file, protocol, byref, fmode, recurse, **kwds)#, strictio)
File "/home/upload/airflow-2.0/local/lib/python3.6/site-packages/dill/_dill.py", line 267, in dump
Pickler(file, protocol, **_kwds).dump(obj)
File "/home/upload/airflow-2.0/local/lib/python3.6/site-packages/dill/_dill.py", line 454, in dump
StockPickler.dump(self, obj)
File "/usr/lib64/python3.6/pickle.py", line 409, in dump
self.save(obj)
File "/usr/lib64/python3.6/pickle.py", line 521, in save
self.save_reduce(obj=obj, *rv)
File "/usr/lib64/python3.6/pickle.py", line 634, in save_reduce
save(state)
File "/usr/lib64/python3.6/pickle.py", line 476, in save
f(self, obj) # Call unbound method with explicit self
File "/home/upload/airflow-2.0/local/lib/python3.6/site-packages/dill/_dill.py", line 941, in save_module_dict
StockPickler.save_dict(pickler, obj)
File "/usr/lib64/python3.6/pickle.py", line 821, in save_dict
self._batch_setitems(obj.items())
File "/usr/lib64/python3.6/pickle.py", line 847, in _batch_setitems
save(v)
File "/usr/lib64/python3.6/pickle.py", line 521, in save
self.save_reduce(obj=obj, *rv)
File "/usr/lib64/python3.6/pickle.py", line 634, in save_reduce
save(state)
File "/usr/lib64/python3.6/pickle.py", line 476, in save
f(self, obj) # Call unbound method with explicit self
File "/home/upload/airflow-2.0/local/lib/python3.6/site-packages/dill/_dill.py", line 941, in save_module_dict
StockPickler.save_dict(pickler, obj)
File "/usr/lib64/python3.6/pickle.py", line 821, in save_dict
self._batch_setitems(obj.items())
File "/usr/lib64/python3.6/pickle.py", line 847, in _batch_setitems
save(v)
File "/usr/lib64/python3.6/pickle.py", line 521, in save
self.save_reduce(obj=obj, *rv)
File "/usr/lib64/python3.6/pickle.py", line 634, in save_reduce
save(state)
File "/usr/lib64/python3.6/pickle.py", line 476, in save
f(self, obj) # Call unbound method with explicit self
File "/home/upload/airflow-2.0/local/lib/python3.6/site-packages/dill/_dill.py", line 941, in save_module_dict
StockPickler.save_dict(pickler, obj)
File "/usr/lib64/python3.6/pickle.py", line 821, in save_dict
self._batch_setitems(obj.items())
File "/usr/lib64/python3.6/pickle.py", line 847, in _batch_setitems
save(v)
File "/usr/lib64/python3.6/pickle.py", line 521, in save
self.save_reduce(obj=obj, *rv)
File "/usr/lib64/python3.6/pickle.py", line 634, in save_reduce
save(state)
File "/usr/lib64/python3.6/pickle.py", line 476, in save
f(self, obj) # Call unbound method with explicit self
File "/home/upload/airflow-2.0/local/lib/python3.6/site-packages/dill/_dill.py", line 941, in save_module_dict
StockPickler.save_dict(pickler, obj)
File "/usr/lib64/python3.6/pickle.py", line 821, in save_dict
self._batch_setitems(obj.items())
File "/usr/lib64/python3.6/pickle.py", line 847, in _batch_setitems
save(v)
File "/usr/lib64/python3.6/pickle.py", line 476, in save
f(self, obj) # Call unbound method with explicit self
File "/home/upload/airflow-2.0/local/lib/python3.6/site-packages/dill/_dill.py", line 941, in save_module_dict
StockPickler.save_dict(pickler, obj)
File "/usr/lib64/python3.6/pickle.py", line 821, in save_dict
self._batch_setitems(obj.items())
File "/usr/lib64/python3.6/pickle.py", line 847, in _batch_setitems
save(v)
File "/usr/lib64/python3.6/pickle.py", line 521, in save
self.save_reduce(obj=obj, *rv)
File "/usr/lib64/python3.6/pickle.py", line 634, in save_reduce
save(state)
File "/usr/lib64/python3.6/pickle.py", line 476, in save
f(self, obj) # Call unbound method with explicit self
File "/home/upload/airflow-2.0/local/lib/python3.6/site-packages/dill/_dill.py", line 941, in save_module_dict
StockPickler.save_dict(pickler, obj)
File "/usr/lib64/python3.6/pickle.py", line 821, in save_dict
self._batch_setitems(obj.items())
File "/usr/lib64/python3.6/pickle.py", line 847, in _batch_setitems
save(v)
File "/usr/lib64/python3.6/pickle.py", line 476, in save
f(self, obj) # Call unbound method with explicit self
File "/home/upload/airflow-2.0/local/lib/python3.6/site-packages/dill/_dill.py", line 941, in save_module_dict
StockPickler.save_dict(pickler, obj)
File "/usr/lib64/python3.6/pickle.py", line 821, in save_dict
self._batch_setitems(obj.items())
File "/usr/lib64/python3.6/pickle.py", line 846, in _batch_setitems
save(k)
File "/usr/lib64/python3.6/pickle.py", line 521, in save
self.save_reduce(obj=obj, *rv)
File "/usr/lib64/python3.6/pickle.py", line 634, in save_reduce
save(state)
File "/usr/lib64/python3.6/pickle.py", line 476, in save
f(self, obj) # Call unbound method with explicit self
File "/home/upload/airflow-2.0/local/lib/python3.6/site-packages/dill/_dill.py", line 941, in save_module_dict
StockPickler.save_dict(pickler, obj)
File "/usr/lib64/python3.6/pickle.py", line 821, in save_dict
self._batch_setitems(obj.items())
File "/usr/lib64/python3.6/pickle.py", line 847, in _batch_setitems
save(v)
File "/usr/lib64/python3.6/pickle.py", line 476, in save
f(self, obj) # Call unbound method with explicit self
File "/usr/lib64/python3.6/pickle.py", line 781, in save_list
self._batch_appends(obj)
File "/usr/lib64/python3.6/pickle.py", line 808, in _batch_appends
save(tmp[0])
File "/usr/lib64/python3.6/pickle.py", line 521, in save
self.save_reduce(obj=obj, *rv)
File "/usr/lib64/python3.6/pickle.py", line 634, in save_reduce
save(state)
File "/usr/lib64/python3.6/pickle.py", line 476, in save
f(self, obj) # Call unbound method with explicit self
File "/home/upload/airflow-2.0/local/lib/python3.6/site-packages/dill/_dill.py", line 941, in save_module_dict
StockPickler.save_dict(pickler, obj)
File "/usr/lib64/python3.6/pickle.py", line 821, in save_dict
self._batch_setitems(obj.items())
File "/usr/lib64/python3.6/pickle.py", line 847, in _batch_setitems
save(v)
File "/usr/lib64/python3.6/pickle.py", line 521, in save
self.save_reduce(obj=obj, *rv)
File "/usr/lib64/python3.6/pickle.py", line 634, in save_reduce
save(state)
File "/usr/lib64/python3.6/pickle.py", line 476, in save
f(self, obj) # Call unbound method with explicit self
File "/home/upload/airflow-2.0/local/lib/python3.6/site-packages/dill/_dill.py", line 941, in save_module_dict
StockPickler.save_dict(pickler, obj)
File "/usr/lib64/python3.6/pickle.py", line 821, in save_dict
self._batch_setitems(obj.items())
File "/usr/lib64/python3.6/pickle.py", line 847, in _batch_setitems
save(v)
File "/usr/lib64/python3.6/pickle.py", line 476, in save
f(self, obj) # Call unbound method with explicit self
File "/home/upload/airflow-2.0/local/lib/python3.6/site-packages/dill/_dill.py", line 1447, in save_function
obj.__dict__, fkwdefaults), obj=obj)
File "/usr/lib64/python3.6/pickle.py", line 610, in save_reduce
save(args)
File "/usr/lib64/python3.6/pickle.py", line 476, in save
f(self, obj) # Call unbound method with explicit self
File "/usr/lib64/python3.6/pickle.py", line 751, in save_tuple
save(element)
File "/usr/lib64/python3.6/pickle.py", line 476, in save
f(self, obj) # Call unbound method with explicit self
File "/home/upload/airflow-2.0/local/lib/python3.6/site-packages/dill/_dill.py", line 941, in save_module_dict
StockPickler.save_dict(pickler, obj)
File "/usr/lib64/python3.6/pickle.py", line 821, in save_dict
self._batch_setitems(obj.items())
File "/usr/lib64/python3.6/pickle.py", line 847, in _batch_setitems
save(v)
File "/usr/lib64/python3.6/pickle.py", line 521, in save
self.save_reduce(obj=obj, *rv)
File "/usr/lib64/python3.6/pickle.py", line 605, in save_reduce
save(cls)
File "/usr/lib64/python3.6/pickle.py", line 476, in save
f(self, obj) # Call unbound method with explicit self
File "/home/upload/airflow-2.0/local/lib/python3.6/site-packages/dill/_dill.py", line 1390, in save_type
StockPickler.save_global(pickler, obj, name=name)
File "/usr/lib64/python3.6/pickle.py", line 922, in save_global
(obj, module_name, name))
_pickle.PicklingError: Can't pickle <class 'jinja2.utils.MissingType'>: it's not found as jinja2.utils.MissingType
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/lib64/python3.6/multiprocessing/process.py", line 249, in _bootstrap
self.run()
File "/usr/lib64/python3.6/multiprocessing/process.py", line 93, in run
self._target(*self._args, **self._kwargs)
File "/home/upload/airflow-2.0/local/lib/python3.6/site-packages/airflow/jobs/scheduler_job.py", line 187, in _run_file_processor
callback_requests=callback_requests,
File "/home/upload/airflow-2.0/local/lib/python3.6/site-packages/airflow/utils/session.py", line 65, in wrapper
return func(*args, session=session, **kwargs)
File "/home/upload/airflow-2.0/local/lib/python3.6/site-packages/airflow/jobs/scheduler_job.py", line 658, in process_file
dag.pickle(session)
File "/home/upload/airflow-2.0/local/lib/python3.6/site-packages/airflow/utils/session.py", line 62, in wrapper
return func(*args, **kwargs)
File "/home/upload/airflow-2.0/local/lib/python3.6/site-packages/airflow/models/dag.py", line 1558, in pickle
session.commit()
File "/home/upload/airflow-2.0/local/lib64/python3.6/site-packages/sqlalchemy/orm/session.py", line 1046, in commit
self.transaction.commit()
File "/home/upload/airflow-2.0/local/lib64/python3.6/site-packages/sqlalchemy/orm/session.py", line 504, in commit
self._prepare_impl()
File "/home/upload/airflow-2.0/local/lib64/python3.6/site-packages/sqlalchemy/orm/session.py", line 483, in _prepare_impl
self.session.flush()
File "/home/upload/airflow-2.0/local/lib64/python3.6/site-packages/sqlalchemy/orm/session.py", line 2540, in flush
self._flush(objects)
File "/home/upload/airflow-2.0/local/lib64/python3.6/site-packages/sqlalchemy/orm/session.py", line 2682, in _flush
transaction.rollback(_capture_exception=True)
File "/home/upload/airflow-2.0/local/lib64/python3.6/site-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__
with_traceback=exc_tb,
File "/home/upload/airflow-2.0/local/lib64/python3.6/site-packages/sqlalchemy/util/compat.py", line 182, in raise_
raise exception
File "/home/upload/airflow-2.0/local/lib64/python3.6/site-packages/sqlalchemy/orm/session.py", line 2642, in _flush
flush_context.execute()
File "/home/upload/airflow-2.0/local/lib64/python3.6/site-packages/sqlalchemy/orm/unitofwork.py", line 422, in execute
rec.execute(self)
File "/home/upload/airflow-2.0/local/lib64/python3.6/site-packages/sqlalchemy/orm/unitofwork.py", line 589, in execute
uow,
File "/home/upload/airflow-2.0/local/lib64/python3.6/site-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj
insert,
File "/home/upload/airflow-2.0/local/lib64/python3.6/site-packages/sqlalchemy/orm/persistence.py", line 1136, in _emit_insert_statements
statement, params
File "/home/upload/airflow-2.0/local/lib64/python3.6/site-packages/sqlalchemy/engine/base.py", line 1011, in execute
return meth(self, multiparams, params)
File "/home/upload/airflow-2.0/local/lib64/python3.6/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection
return connection._execute_clauseelement(self, multiparams, params)
File "/home/upload/airflow-2.0/local/lib64/python3.6/site-packages/sqlalchemy/engine/base.py", line 1130, in _execute_clauseelement
distilled_params,
File "/home/upload/airflow-2.0/local/lib64/python3.6/site-packages/sqlalchemy/engine/base.py", line 1207, in _execute_context
e, util.text_type(statement), parameters, None, None
File "/home/upload/airflow-2.0/local/lib64/python3.6/site-packages/sqlalchemy/engine/base.py", line 1511, in _handle_dbapi_exception
sqlalchemy_exception, with_traceback=exc_info[2], from_=e
File "/home/upload/airflow-2.0/local/lib64/python3.6/site-packages/sqlalchemy/util/compat.py", line 182, in raise_
raise exception
File "/home/upload/airflow-2.0/local/lib64/python3.6/site-packages/sqlalchemy/engine/base.py", line 1204, in _execute_context
context = constructor(dialect, self, conn, *args)
File "/home/upload/airflow-2.0/local/lib64/python3.6/site-packages/sqlalchemy/engine/default.py", line 854, in _init_compiled
param.append(processors[key](compiled_params[key]))
File "/home/upload/airflow-2.0/local/lib64/python3.6/site-packages/sqlalchemy/sql/sqltypes.py", line 1702, in process
value = dumps(value, protocol)
File "/home/upload/airflow-2.0/local/lib/python3.6/site-packages/dill/_dill.py", line 273, in dumps
dump(obj, file, protocol, byref, fmode, recurse, **kwds)#, strictio)
File "/home/upload/airflow-2.0/local/lib/python3.6/site-packages/dill/_dill.py", line 267, in dump
Pickler(file, protocol, **_kwds).dump(obj)
File "/home/upload/airflow-2.0/local/lib/python3.6/site-packages/dill/_dill.py", line 454, in dump
StockPickler.dump(self, obj)
File "/usr/lib64/python3.6/pickle.py", line 409, in dump
self.save(obj)
File "/usr/lib64/python3.6/pickle.py", line 521, in save
self.save_reduce(obj=obj, *rv)
File "/usr/lib64/python3.6/pickle.py", line 634, in save_reduce
save(state)
File "/usr/lib64/python3.6/pickle.py", line 476, in save
f(self, obj) # Call unbound method with explicit self
File "/home/upload/airflow-2.0/local/lib/python3.6/site-packages/dill/_dill.py", line 941, in save_module_dict
StockPickler.save_dict(pickler, obj)
File "/usr/lib64/python3.6/pickle.py", line 821, in save_dict
self._batch_setitems(obj.items())
File "/usr/lib64/python3.6/pickle.py", line 847, in _batch_setitems
save(v)
File "/usr/lib64/python3.6/pickle.py", line 521, in save
self.save_reduce(obj=obj, *rv)
File "/usr/lib64/python3.6/pickle.py", line 634, in save_reduce
save(state)
File "/usr/lib64/python3.6/pickle.py", line 476, in save
f(self, obj) # Call unbound method with explicit self
File "/home/upload/airflow-2.0/local/lib/python3.6/site-packages/dill/_dill.py", line 941, in save_module_dict
StockPickler.save_dict(pickler, obj)
File "/usr/lib64/python3.6/pickle.py", line 821, in save_dict
self._batch_setitems(obj.items())
File "/usr/lib64/python3.6/pickle.py", line 847, in _batch_setitems
save(v)
File "/usr/lib64/python3.6/pickle.py", line 521, in save
self.save_reduce(obj=obj, *rv)
File "/usr/lib64/python3.6/pickle.py", line 634, in save_reduce
save(state)
File "/usr/lib64/python3.6/pickle.py", line 476, in save
f(self, obj) # Call unbound method with explicit self
File "/home/upload/airflow-2.0/local/lib/python3.6/site-packages/dill/_dill.py", line 941, in save_module_dict
StockPickler.save_dict(pickler, obj)
File "/usr/lib64/python3.6/pickle.py", line 821, in save_dict
self._batch_setitems(obj.items())
File "/usr/lib64/python3.6/pickle.py", line 847, in _batch_setitems
save(v)
File "/usr/lib64/python3.6/pickle.py", line 521, in save
self.save_reduce(obj=obj, *rv)
File "/usr/lib64/python3.6/pickle.py", line 634, in save_reduce
save(state)
File "/usr/lib64/python3.6/pickle.py", line 476, in save
f(self, obj) # Call unbound method with explicit self
File "/home/upload/airflow-2.0/local/lib/python3.6/site-packages/dill/_dill.py", line 941, in save_module_dict
StockPickler.save_dict(pickler, obj)
File "/usr/lib64/python3.6/pickle.py", line 821, in save_dict
self._batch_setitems(obj.items())
File "/usr/lib64/python3.6/pickle.py", line 847, in _batch_setitems
save(v)
File "/usr/lib64/python3.6/pickle.py", line 476, in save
f(self, obj) # Call unbound method with explicit self
File "/home/upload/airflow-2.0/local/lib/python3.6/site-packages/dill/_dill.py", line 941, in save_module_dict
StockPickler.save_dict(pickler, obj)
File "/usr/lib64/python3.6/pickle.py", line 821, in save_dict
self._batch_setitems(obj.items())
File "/usr/lib64/python3.6/pickle.py", line 847, in _batch_setitems
save(v)
File "/usr/lib64/python3.6/pickle.py", line 521, in save
self.save_reduce(obj=obj, *rv)
File "/usr/lib64/python3.6/pickle.py", line 634, in save_reduce
save(state)
File "/usr/lib64/python3.6/pickle.py", line 476, in save
f(self, obj) # Call unbound method with explicit self
File "/home/upload/airflow-2.0/local/lib/python3.6/site-packages/dill/_dill.py", line 941, in save_module_dict
StockPickler.save_dict(pickler, obj)
File "/usr/lib64/python3.6/pickle.py", line 821, in save_dict
self._batch_setitems(obj.items())
File "/usr/lib64/python3.6/pickle.py", line 847, in _batch_setitems
save(v)
File "/usr/lib64/python3.6/pickle.py", line 476, in save
f(self, obj) # Call unbound method with explicit self
File "/home/upload/airflow-2.0/local/lib/python3.6/site-packages/dill/_dill.py", line 941, in save_module_dict
StockPickler.save_dict(pickler, obj)
File "/usr/lib64/python3.6/pickle.py", line 821, in save_dict
self._batch_setitems(obj.items())
File "/usr/lib64/python3.6/pickle.py", line 846, in _batch_setitems
save(k)
File "/usr/lib64/python3.6/pickle.py", line 521, in save
self.save_reduce(obj=obj, *rv)
File "/usr/lib64/python3.6/pickle.py", line 634, in save_reduce
save(state)
File "/usr/lib64/python3.6/pickle.py", line 476, in save
f(self, obj) # Call unbound method with explicit self
File "/home/upload/airflow-2.0/local/lib/python3.6/site-packages/dill/_dill.py", line 941, in save_module_dict
StockPickler.save_dict(pickler, obj)
File "/usr/lib64/python3.6/pickle.py", line 821, in save_dict
self._batch_setitems(obj.items())
File "/usr/lib64/python3.6/pickle.py", line 847, in _batch_setitems
save(v)
File "/usr/lib64/python3.6/pickle.py", line 476, in save
f(self, obj) # Call unbound method with explicit self
File "/usr/lib64/python3.6/pickle.py", line 781, in save_list
self._batch_appends(obj)
File "/usr/lib64/python3.6/pickle.py", line 808, in _batch_appends
save(tmp[0])
File "/usr/lib64/python3.6/pickle.py", line 521, in save
self.save_reduce(obj=obj, *rv)
File "/usr/lib64/python3.6/pickle.py", line 634, in save_reduce
save(state)
File "/usr/lib64/python3.6/pickle.py", line 476, in save
f(self, obj) # Call unbound method with explicit self
File "/home/upload/airflow-2.0/local/lib/python3.6/site-packages/dill/_dill.py", line 941, in save_module_dict
StockPickler.save_dict(pickler, obj)
File "/usr/lib64/python3.6/pickle.py", line 821, in save_dict
self._batch_setitems(obj.items())
File "/usr/lib64/python3.6/pickle.py", line 847, in _batch_setitems
save(v)
File "/usr/lib64/python3.6/pickle.py", line 521, in save
self.save_reduce(obj=obj, *rv)
File "/usr/lib64/python3.6/pickle.py", line 634, in save_reduce
save(state)
File "/usr/lib64/python3.6/pickle.py", line 476, in save
f(self, obj) # Call unbound method with explicit self
File "/home/upload/airflow-2.0/local/lib/python3.6/site-packages/dill/_dill.py", line 941, in save_module_dict
StockPickler.save_dict(pickler, obj)
File "/usr/lib64/python3.6/pickle.py", line 821, in save_dict
self._batch_setitems(obj.items())
File "/usr/lib64/python3.6/pickle.py", line 847, in _batch_setitems
save(v)
File "/usr/lib64/python3.6/pickle.py", line 476, in save
f(self, obj) # Call unbound method with explicit self
File "/home/upload/airflow-2.0/local/lib/python3.6/site-packages/dill/_dill.py", line 1447, in save_function
obj.__dict__, fkwdefaults), obj=obj)
File "/usr/lib64/python3.6/pickle.py", line 610, in save_reduce
save(args)
File "/usr/lib64/python3.6/pickle.py", line 476, in save
f(self, obj) # Call unbound method with explicit self
File "/usr/lib64/python3.6/pickle.py", line 751, in save_tuple
save(element)
File "/usr/lib64/python3.6/pickle.py", line 476, in save
f(self, obj) # Call unbound method with explicit self
File "/home/upload/airflow-2.0/local/lib/python3.6/site-packages/dill/_dill.py", line 941, in save_module_dict
StockPickler.save_dict(pickler, obj)
File "/usr/lib64/python3.6/pickle.py", line 821, in save_dict
self._batch_setitems(obj.items())
File "/usr/lib64/python3.6/pickle.py", line 847, in _batch_setitems
save(v)
File "/usr/lib64/python3.6/pickle.py", line 521, in save
self.save_reduce(obj=obj, *rv)
File "/usr/lib64/python3.6/pickle.py", line 605, in save_reduce
save(cls)
File "/usr/lib64/python3.6/pickle.py", line 476, in save
f(self, obj) # Call unbound method with explicit self
File "/home/upload/airflow-2.0/local/lib/python3.6/site-packages/dill/_dill.py", line 1390, in save_type
StockPickler.save_global(pickler, obj, name=name)
File "/usr/lib64/python3.6/pickle.py", line 922, in save_global
(obj, module_name, name))
sqlalchemy.exc.StatementError: (_pickle.PicklingError) Can't pickle <class 'jinja2.utils.MissingType'>: it's not found as jinja2.utils.MissingType
The list is my running env:
airflow 2.0.1
my dag is
from airflow import DAG
from airflow.operators.python import PythonOperator
from airflow.utils.dates import days_ago
args = {
'owner': 'nancy',
}
with DAG(
dag_id='verify_python_function',
default_args=args,
schedule_interval='0 2 * * *',
start_date=days_ago(2)
) as dag:
# [START howto_operator_python_kwargs]
def print_function(**kwargs):
"""This is a function that will run within the DAG execution"""
print(kwargs['year'])
# Generate 5 sleeping tasks, sleeping from 0.0 to 0.4 seconds respectively
task = PythonOperator(
task_id='sleep_for_1',
python_callable=print_function,
op_kwargs={"year":"{{ macros.ds_format(macros.ds_add(ds,-1), '%Y-%m-%d','%Y') }}","month":"{{ macros.ds_format(macros.ds_add(ds,-1), '%Y-%m-%d','%m') }}","day":"{{ macros.ds_format(macros.ds_add(ds,-1), '%Y-%m-%d','%d') }}"},
The dag is worked on the airflow 1.10.14, but on the 2.0.1,there has some error logs, but the dag can work well.
Has anyone encountered this kind of problem here?
reacted with thumbs up emoji reacted with thumbs down emoji reacted with laugh emoji reacted with hooray emoji reacted with confused emoji reacted with heart emoji reacted with rocket emoji reacted with eyes emoji
-
Hi,
When i start the airflow scheduler like:
airflow scheduler --do-pickle
Here are some error logs like:
The list is my running env:
The dag is worked on the airflow 1.10.14, but on the 2.0.1,there has some error logs, but the dag can work well.
Has anyone encountered this kind of problem here?
Beta Was this translation helpful? Give feedback.
All reactions