-- Logs begin at Sat 2022-09-24 18:50:02 UTC, end at Sat 2022-09-24 19:47:58 UTC. -- Sep 24 19:20:05.308348 dv-osbrick-859195-1-ceph systemd[1]: Starting Devstack devstack@keystone.service... Sep 24 19:20:05.315773 dv-osbrick-859195-1-ceph devstack@keystone.service[88066]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Sep 24 19:20:05.317783 dv-osbrick-859195-1-ceph devstack@keystone.service[88066]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Sep 24 19:20:05 2022] *** Sep 24 19:20:05.317783 dv-osbrick-859195-1-ceph devstack@keystone.service[88066]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 24 19:20:05.324205 dv-osbrick-859195-1-ceph devstack@keystone.service[88066]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 24 19:20:05.324205 dv-osbrick-859195-1-ceph devstack@keystone.service[88066]: nodename: dv-osbrick-859195-1-ceph Sep 24 19:20:05.324205 dv-osbrick-859195-1-ceph devstack@keystone.service[88066]: machine: x86_64 Sep 24 19:20:05.324205 dv-osbrick-859195-1-ceph devstack@keystone.service[88066]: clock source: unix Sep 24 19:20:05.324205 dv-osbrick-859195-1-ceph devstack@keystone.service[88066]: pcre jit disabled Sep 24 19:20:05.324205 dv-osbrick-859195-1-ceph devstack@keystone.service[88066]: detected number of CPU cores: 4 Sep 24 19:20:05.324205 dv-osbrick-859195-1-ceph devstack@keystone.service[88066]: current working directory: / Sep 24 19:20:05.324205 dv-osbrick-859195-1-ceph devstack@keystone.service[88066]: detected binary path: /usr/bin/uwsgi-core Sep 24 19:20:05.324205 dv-osbrick-859195-1-ceph devstack@keystone.service[88066]: your processes number limit is 47680 Sep 24 19:20:05.324205 dv-osbrick-859195-1-ceph devstack@keystone.service[88066]: your memory page size is 4096 bytes Sep 24 19:20:05.324205 dv-osbrick-859195-1-ceph devstack@keystone.service[88066]: detected max file descriptor number: 2048 Sep 24 19:20:05.324205 dv-osbrick-859195-1-ceph devstack@keystone.service[88066]: lock engine: pthread robust mutexes Sep 24 19:20:05.324205 dv-osbrick-859195-1-ceph devstack@keystone.service[88066]: thunder lock: enabled Sep 24 19:20:05.324205 dv-osbrick-859195-1-ceph devstack@keystone.service[88066]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Sep 24 19:20:05.324205 dv-osbrick-859195-1-ceph devstack@keystone.service[88066]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 24 19:20:05.363775 dv-osbrick-859195-1-ceph devstack@keystone.service[88066]: Python main interpreter initialized at 0x55e0efefb9c0 Sep 24 19:20:05.363775 dv-osbrick-859195-1-ceph devstack@keystone.service[88066]: python threads support enabled Sep 24 19:20:05.363775 dv-osbrick-859195-1-ceph devstack@keystone.service[88066]: your server socket listen backlog is limited to 100 connections Sep 24 19:20:05.363775 dv-osbrick-859195-1-ceph devstack@keystone.service[88066]: your mercy for graceful operations on workers is 90 seconds Sep 24 19:20:05.364178 dv-osbrick-859195-1-ceph devstack@keystone.service[88066]: mapped 403077 bytes (393 KB) for 2 cores Sep 24 19:20:05.364253 dv-osbrick-859195-1-ceph devstack@keystone.service[88066]: *** Operational MODE: preforking *** Sep 24 19:20:05.364462 dv-osbrick-859195-1-ceph devstack@keystone.service[88066]: *** uWSGI is running in multiple interpreter mode *** Sep 24 19:20:05.364462 dv-osbrick-859195-1-ceph devstack@keystone.service[88066]: spawned uWSGI master process (pid: 88066) Sep 24 19:20:05.364673 dv-osbrick-859195-1-ceph systemd[1]: Started Devstack devstack@keystone.service. Sep 24 19:20:05.365942 dv-osbrick-859195-1-ceph devstack@keystone.service[88066]: spawned uWSGI worker 1 (pid: 88080, cores: 1) Sep 24 19:20:05.365942 dv-osbrick-859195-1-ceph devstack@keystone.service[88066]: spawned uWSGI worker 2 (pid: 88081, cores: 1) Sep 24 19:20:05.365942 dv-osbrick-859195-1-ceph devstack@keystone.service[88066]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 24 19:20:10.043819 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 24 19:20:10.043819 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: from cryptography.utils import int_from_bytes Sep 24 19:20:10.044594 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 24 19:20:10.044594 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: from cryptography.utils import int_from_bytes Sep 24 19:20:10.044708 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 24 19:20:10.044708 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: from cryptography.utils import int_from_bytes Sep 24 19:20:10.045130 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 24 19:20:10.045130 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: from cryptography.utils import int_from_bytes Sep 24 19:20:10.095599 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 24 19:20:10.095770 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 24 19:20:10.095844 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 24 19:20:10.095977 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] command line args: [] {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 24 19:20:10.096107 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 24 19:20:10.096211 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] command line args: [] {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 24 19:20:10.096276 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 24 19:20:10.096406 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] ================================================================================ {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 24 19:20:10.096511 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 24 19:20:10.096598 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] ================================================================================ {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 24 19:20:10.096672 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] admin_token = **** {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:20:10.096821 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] admin_token = **** {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:20:10.096901 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] config_dir = [] {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:20:10.097062 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:20:10.097151 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] config_dir = [] {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:20:10.097244 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] config_source = [] {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:20:10.097322 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:20:10.097423 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] config_source = [] {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:20:10.097501 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] debug = True {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:20:10.097604 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] debug = True {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:20:10.097692 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:20:10.097950 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:20:10.098056 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:20:10.098124 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:20:10.098194 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] insecure_debug = False {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:20:10.098253 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] insecure_debug = False {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:20:10.098399 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:20:10.098519 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:20:10.098644 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:20:10.098757 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:20:10.098867 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] list_limit = None {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:20:10.098970 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] list_limit = None {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:20:10.099074 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] log_config_append = None {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:20:10.099169 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] log_config_append = None {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:20:10.099270 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:20:10.099373 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:20:10.099483 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] log_dir = None {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:20:10.099582 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] log_dir = None {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:20:10.099677 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] log_file = None {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:20:10.099778 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] log_file = None {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:20:10.099903 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:20:10.099985 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:20:10.100113 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:20:10.100189 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:20:10.100310 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:20:10.100391 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:20:10.100507 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:20:10.100592 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:20:10.100674 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:20:10.100794 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:20:10.100875 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:20:10.100948 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:20:10.101064 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:20:10.101148 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:20:10.101282 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:20:10.101381 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:20:10.101481 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:20:10.101603 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:20:10.101712 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:20:10.101799 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:20:10.102010 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:20:10.102107 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:20:10.102199 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:20:10.102318 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:20:10.102444 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:20:10.102531 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:20:10.102660 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] notification_format = cadf {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:20:10.102739 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] notification_format = cadf {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:20:10.103425 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:20:10.103509 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:20:10.103917 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.18/identity {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:20:10.104049 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.18/identity {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:20:10.104133 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] publish_errors = False {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:20:10.104212 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] publish_errors = False {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:20:10.104335 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:20:10.104417 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:20:10.104531 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:20:10.104616 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:20:10.104692 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:20:10.104820 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:20:10.104938 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:20:10.105033 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:20:10.105169 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:20:10.105258 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:20:10.105402 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] standard_threads = False {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:20:10.105490 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] standard_threads = False {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:20:10.105633 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] strict_password_check = False {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:20:10.105712 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] strict_password_check = False {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:20:10.105896 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:20:10.106039 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:20:10.106116 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] use_eventlog = False {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:20:10.106193 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] use_eventlog = False {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:20:10.106263 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] use_journal = False {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:20:10.106337 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] use_journal = False {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:20:10.106413 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] use_json = False {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:20:10.106493 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] use_json = False {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:20:10.106565 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] use_stderr = False {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:20:10.106640 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] use_stderr = False {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:20:10.106710 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] use_syslog = False {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:20:10.106785 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] use_syslog = False {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:20:10.106939 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] watch_log_file = False {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:20:10.107028 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] watch_log_file = False {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 19:20:10.107195 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.107278 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.107429 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.107505 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.107686 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.107774 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.107924 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.108001 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.108168 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.108241 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.108404 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.108480 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.108650 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.108722 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.108883 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.108956 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.109130 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.109219 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.109373 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.109449 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.109620 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.109697 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.109868 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.109966 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.110116 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.110196 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.110385 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.110478 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.110596 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.110683 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.110841 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.110928 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.111073 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.111157 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.111341 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.111762 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.111762 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.111911 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.111980 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.112055 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.112133 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.112213 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.112290 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.112361 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.112509 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.112588 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.112757 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.112847 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.113003 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.113082 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.113233 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.113309 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.113462 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.113540 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.113690 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.113766 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.113944 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.114025 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.114192 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.114339 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.114439 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.114517 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.114664 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.114741 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.114893 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.114971 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.115133 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.115209 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.115377 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.115456 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.115612 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.115692 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.115856 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.115942 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.116086 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.116163 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.116320 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.116401 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.116553 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.116632 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.116782 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.116859 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.117006 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.117085 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.117223 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.117308 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.117451 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.117530 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.117685 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.117770 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.117952 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.118034 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.118185 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.118261 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.118423 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.119098 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.119200 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.119284 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.119443 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.119521 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.119676 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.119754 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.119924 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.120000 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.120153 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.120478 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.120643 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.120722 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.120877 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.120955 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.121112 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.121225 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.121346 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.121426 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.121581 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.121663 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.121809 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.121969 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.122084 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.122196 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.122324 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.122436 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.122676 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.122763 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.122909 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.123006 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.123169 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.123258 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.123411 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.123490 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.123640 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.123720 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.123877 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.123957 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.124114 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.124192 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.124381 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.124468 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.124620 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.124706 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.124869 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.124948 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.125116 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.125202 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.125353 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.125432 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.125590 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.125669 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.125838 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.125931 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.126092 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] cache.enabled = True {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.126172 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] cache.enabled = True {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.126331 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.126412 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.126568 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.126661 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.126813 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.126894 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.127052 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.127130 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.127299 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.127389 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.127536 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.127616 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.127773 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.127853 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.128010 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.128097 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.128245 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.128324 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.128482 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.128562 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.128744 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.128831 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.128986 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.129065 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.129250 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.129330 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.129474 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.129628 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.129704 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.129774 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.129960 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.130042 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.130198 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.130287 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.130432 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.130523 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.130666 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.130745 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.130905 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.131044 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.131119 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.131203 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.131346 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.131565 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.131663 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.131736 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.131806 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.131886 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.132028 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.132110 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.132266 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.132351 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.132514 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.132601 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.132753 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.132833 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.133009 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.133087 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.133271 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.133364 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.133510 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.133616 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.133743 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] auth.external = None {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.133922 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] auth.external = None {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.134003 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] auth.mapped = None {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.134074 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] auth.mapped = None {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.134284 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.134380 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.134518 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.134599 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.134749 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] auth.password = None {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.134829 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] auth.password = None {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.134978 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] auth.token = None {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.135059 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] auth.token = None {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.135219 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.135307 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.135456 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] catalog.caching = True {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.135536 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] catalog.caching = True {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.135704 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.135784 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.135933 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.136011 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.136180 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.136261 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.136426 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.136507 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.136655 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.136736 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.136891 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] credential.caching = True {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.136970 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] credential.caching = True {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.137135 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] credential.driver = sql {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.137222 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] credential.driver = sql {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.137385 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.137465 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.137630 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.137709 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.137913 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.137999 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.138158 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.138251 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.138395 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.138475 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.138663 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.138758 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.138890 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.138970 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.139126 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.139206 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.139380 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.139462 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.139666 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.139760 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.139914 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.139995 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.140178 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.140260 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.140418 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.140498 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.140677 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.140757 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.140935 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] federation.caching = True {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.141063 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] federation.caching = True {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.141145 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.141264 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.141384 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] federation.driver = sql {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.141464 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] federation.driver = sql {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.141630 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.141712 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.141881 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.141964 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.142131 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.142213 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.142390 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.142477 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.142620 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.142701 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.142856 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.142935 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.143111 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.143193 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.143349 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.143428 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.143595 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.143759 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.143838 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] identity.caching = True {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.143910 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] identity.caching = True {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.144067 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.144147 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.144313 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.144402 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.144551 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.144633 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.144786 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.144865 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.145034 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] identity.driver = sql {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.145126 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] identity.driver = sql {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.145264 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.145345 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.145498 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.145578 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.145746 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.145928 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.146012 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.146084 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.146245 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.146325 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.146477 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.146569 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.146708 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.146788 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.146951 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.147032 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.147196 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.147284 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.147466 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.147608 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.147684 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.147756 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.147929 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.148020 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.148280 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.148370 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.148444 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.148516 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.148657 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.148746 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.148889 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.148970 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.149124 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.149203 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.149351 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.149438 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.149588 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.149674 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.149852 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.149935 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.150089 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.150183 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.150336 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.150417 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.150567 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.150646 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.150812 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.150899 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.151056 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.151135 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.151292 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.151371 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.151534 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.151621 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.151779 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.151858 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.152005 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.152083 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.152240 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.152329 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.152470 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] ldap.password = **** {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.152549 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] ldap.password = **** {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.152704 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.152782 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.152938 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.153027 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.153183 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.153264 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.153417 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.153503 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.153655 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.153742 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.153926 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.154010 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.154176 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.154260 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.154409 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.154497 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.154636 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.154715 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.154884 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.154972 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.155129 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.155217 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.155367 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.155446 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.155601 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.155687 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.155839 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.155919 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.156066 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] ldap.user = None {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.156145 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] ldap.user = None {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.156309 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.156388 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.156565 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.156647 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.156795 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.156874 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.157040 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.157118 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.157285 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.157366 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.157527 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.157606 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.157762 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.157859 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.158015 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.158099 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.158253 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.158334 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.158488 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.158568 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.158722 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.158802 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.158952 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.159031 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.159196 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.159275 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.159441 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.159523 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.159686 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.159770 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.159930 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.160010 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.160171 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.160251 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.160401 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.160481 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.160702 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.160851 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.160935 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.161009 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.161106 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.161186 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.161338 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.161417 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.161571 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.161653 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.161813 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.161923 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.162083 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.162161 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.162318 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.162400 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.162570 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] policy.driver = sql {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.162649 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] policy.driver = sql {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.162800 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.162878 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.163045 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.163124 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.163278 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.163357 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.163512 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] receipt.caching = True {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.163590 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] receipt.caching = True {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.163746 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.163826 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.163989 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.164067 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.164231 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.164318 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.164461 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.164542 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.164699 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.164778 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.164939 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] resource.caching = True {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.165018 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] resource.caching = True {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.165187 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.165811 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.165989 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] resource.driver = sql {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.166061 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] resource.driver = sql {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.166201 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.166285 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.166451 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.166533 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.166705 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.166785 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.166942 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] revoke.caching = True {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.167021 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] revoke.caching = True {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.167171 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.167248 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.167410 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.167490 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.167651 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] role.cache_time = None {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.167731 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] role.cache_time = None {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.167888 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] role.caching = True {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.167969 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] role.caching = True {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.168136 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] role.driver = sql {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.168215 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] role.driver = sql {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.168363 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] role.list_limit = None {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.168441 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] role.list_limit = None {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.168613 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.168693 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.168855 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.168936 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.169102 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.169189 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.169346 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.169428 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.169592 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.169671 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.169849 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.169944 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.170099 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.170223 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.170344 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.170423 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.170574 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.170663 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.170818 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.170898 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.171063 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.171144 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.171307 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.171394 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.171552 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.171632 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.171984 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.172064 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.172219 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.172306 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.172467 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.172547 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.172716 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.172795 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.172965 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.173054 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.173216 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.173296 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.173446 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.173525 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.173701 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.173791 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.173975 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.174058 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.174213 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.174298 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.174444 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.174527 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.174676 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.174757 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.174908 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.174986 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.175157 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.175237 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.175411 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.175491 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.175659 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.175738 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.175896 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.175976 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.176131 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.176210 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.176360 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] token.cache_time = None {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.176437 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] token.cache_time = None {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.176596 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] token.caching = True {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.176676 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] token.caching = True {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.176832 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.176909 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.177080 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] token.provider = fernet {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.177159 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] token.provider = fernet {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.177314 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.177394 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.177576 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.177687 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.177821 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.177994 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.178081 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.178156 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.178308 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.178389 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.178552 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.178631 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.178798 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] trust.driver = sql {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.178878 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] trust.driver = sql {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.179034 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.179113 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.179270 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.179349 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.179505 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.179585 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.179747 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.179826 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.180027 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.180107 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.180258 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.180348 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.180501 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.180595 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.180766 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.180845 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.181573 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] database.connection = **** {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.181667 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] database.connection = **** {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.181819 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.181933 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.182116 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.182204 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.182388 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.182476 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.182614 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.182712 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.182850 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.182929 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.183086 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.183217 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.183323 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.183413 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.183557 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.183636 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.183803 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.183881 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.184036 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.184124 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.184279 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.184358 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.184513 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.184592 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.184760 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.184848 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.184994 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.185073 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.185240 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.185364 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.185493 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.185636 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.185769 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.185941 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.185941 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.186192 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 19:20:10.186326 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88081) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 24 19:20:10.186483 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 24 19:20:10.217735 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=88081) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 19:20:10.217986 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=88081) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 19:20:10.218217 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=88081) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 19:20:10.220126 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=88080) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 19:20:10.220356 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=88080) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 19:20:10.220583 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=88080) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 19:20:10.226922 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=88081) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 19:20:10.229731 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=88080) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 19:20:10.255546 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=88081) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 19:20:10.255767 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=88081) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 19:20:10.257391 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=88080) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 19:20:10.257622 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=88080) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 19:20:10.310508 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=88081) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 19:20:10.310754 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=88080) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 19:20:10.360687 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=88080) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 19:20:10.360913 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=88081) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 19:20:10.360986 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=88080) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 19:20:10.361048 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=88081) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 19:20:10.428678 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88080) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 19:20:10.428939 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=88080) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 19:20:10.429049 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88081) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 19:20:10.429133 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=88080) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 19:20:10.429239 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=88081) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 19:20:10.429324 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=88080) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 19:20:10.429467 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=88081) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 19:20:10.429607 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=88080) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 19:20:10.429688 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=88081) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 19:20:10.429761 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=88080) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 19:20:10.429930 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=88081) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 19:20:10.430150 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=88081) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 19:20:10.452720 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88080) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 19:20:10.452945 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=88080) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 19:20:10.453031 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88081) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 19:20:10.453171 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=88080) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 19:20:10.453254 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=88081) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 19:20:10.453392 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=88080) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 19:20:10.453497 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=88081) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 19:20:10.453639 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=88080) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 19:20:10.453768 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=88081) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 19:20:10.453881 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=88080) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 19:20:10.453981 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=88081) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 19:20:10.454073 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=88081) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 19:20:10.454151 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88080) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 19:20:10.454292 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88081) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 19:20:10.465661 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=88080) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 19:20:10.466001 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=88081) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 19:20:10.480711 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88081) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 19:20:10.480943 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=88081) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 19:20:10.481173 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=88081) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 19:20:10.481399 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=88081) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 19:20:10.481617 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=88081) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 19:20:10.481857 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=88081) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 19:20:10.482074 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88081) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 19:20:10.487967 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88080) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 19:20:10.488201 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=88080) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 19:20:10.488475 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=88080) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 19:20:10.488740 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=88080) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 19:20:10.488971 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=88080) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 19:20:10.489194 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=88080) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 19:20:10.489414 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88080) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 19:20:10.500396 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=88081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:20:10.500525 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=88080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:20:10.500626 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=88081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 24 19:20:10.500709 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=88080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 24 19:20:10.500946 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=88081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:20:10.501032 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=88080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:20:10.501149 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=88081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 24 19:20:10.501233 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=88080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 24 19:20:10.501426 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=88080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:20:10.501510 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=88081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:20:10.501690 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=88080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:20:10.501774 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=88081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:20:10.501981 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=88080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:20:10.502079 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=88081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:20:10.502240 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=88081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:20:10.502322 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=88080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:20:10.511704 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=88080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:20:10.511794 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=88081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:20:10.511988 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=88080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:20:10.512084 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=88081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:20:10.512260 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=88080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:20:10.512344 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=88081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:20:10.512544 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=88080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:20:10.512627 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=88081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:20:10.519466 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=88081) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 19:20:10.519563 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=88080) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 19:20:10.522366 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=88081) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 19:20:10.522458 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=88080) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 19:20:10.522657 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=88081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:20:10.522753 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=88080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:20:10.522949 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=88081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:20:10.523031 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=88080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:20:10.523238 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=88081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:20:10.523320 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=88080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:20:10.523526 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=88081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:20:10.523610 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=88080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:20:10.523786 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=88080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:20:10.523866 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=88081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:20:10.524057 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=88080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:20:10.524139 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=88081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:20:10.524337 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=88081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:20:10.524419 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=88080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:20:10.524614 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=88081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:20:10.525191 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=88080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:20:10.525403 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=88081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:20:10.525492 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=88080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:20:10.525677 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=88081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:20:10.525757 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=88080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:20:10.548971 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=88081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:20:10.549080 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=88080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:20:10.550476 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=88081) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 19:20:10.550580 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=88080) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 19:20:10.550774 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=88080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:20:10.550858 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=88081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:20:10.555291 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=88080) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 19:20:10.555386 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=88081) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 19:20:10.555576 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=88080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:20:10.555661 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=88081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:20:10.557567 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=88080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:20:10.557688 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=88081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:20:10.564095 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=88081) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 19:20:10.564225 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=88080) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 19:20:10.564314 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=88080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:20:10.564437 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=88081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:20:10.568303 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=88081) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 19:20:10.568410 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=88080) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 19:20:10.568596 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=88081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:20:10.568721 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=88080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:20:10.568879 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=88080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:20:10.568964 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=88081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:20:10.569274 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=88080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:20:10.569369 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=88081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:20:10.569554 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=88081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:20:10.569638 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=88080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:20:10.569853 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=88080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:20:10.569947 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=88081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:20:10.570128 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=88080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:20:10.570232 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=88081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:20:10.570403 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=88080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:20:10.570487 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=88081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:20:10.585794 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=88080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:20:10.586089 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=88081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:20:10.586176 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=88080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:20:10.586381 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=88081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:20:10.590505 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=88080) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 19:20:10.590773 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=88081) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 19:20:10.593602 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=88080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:20:10.593914 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=88081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:20:10.594058 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=88080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:20:10.594332 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=88081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:20:10.598259 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=88080) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 19:20:10.598571 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=88081) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 19:20:10.601384 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=88080) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 19:20:10.601688 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=88081) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 19:20:10.605099 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=88080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:20:10.605358 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=88081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:20:10.605448 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=88080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:20:10.605663 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=88081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:20:10.605763 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=88080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:20:10.605980 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=88081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:20:10.606098 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=88080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:20:10.606391 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=88081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:20:10.606474 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=88080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:20:10.606675 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=88080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:20:10.606761 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=88081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:20:10.606965 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=88081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:20:10.622726 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=88080) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 19:20:10.623025 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=88080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:20:10.623130 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=88081) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 19:20:10.623298 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=88080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:20:10.623383 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=88081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:20:10.623561 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=88080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:20:10.623645 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=88081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:20:10.623853 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=88081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:20:10.630325 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=88080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:20:10.630639 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=88081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:20:10.631963 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=88080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:20:10.632345 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=88081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:20:10.633511 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=88080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:20:10.633789 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=88080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:20:10.633917 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=88081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:20:10.634639 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=88081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:20:10.636953 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=88080) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 19:20:10.637244 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=88080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:20:10.637329 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=88081) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 19:20:10.637536 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=88080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:20:10.637623 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=88081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:20:10.637846 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=88080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:20:10.637941 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=88081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:20:10.638128 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=88080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:20:10.638215 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=88081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:20:10.638697 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=88081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:20:10.650518 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=88080) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 19:20:10.650815 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=88080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:20:10.651102 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=88080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:20:10.651389 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=88080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:20:10.651508 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=88081) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 19:20:10.651678 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=88080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:20:10.651820 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=88081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:20:10.652001 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=88080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:20:10.652142 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=88081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:20:10.652271 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=88080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:20:10.652401 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=88081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:20:10.652647 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=88081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:20:10.652944 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=88081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:20:10.653222 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=88081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:20:10.667763 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=88080) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 19:20:10.668985 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=88081) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 19:20:10.670810 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=88080) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 19:20:10.672050 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=88081) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 19:20:10.673692 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=88080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:20:10.675019 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=88081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:20:10.675150 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=88080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:20:10.676464 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=88081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:20:10.676597 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=88080) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 19:20:10.676880 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=88080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:20:10.677186 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=88080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:20:10.677959 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=88081) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 19:20:10.678252 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=88081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:20:10.678546 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=88081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:20:10.683649 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=88080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:20:10.685008 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=88081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:20:10.685113 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=88080) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 19:20:10.686497 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=88081) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 19:20:10.687992 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=88080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:20:10.688295 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=88080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:20:10.688579 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=88080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:20:10.688854 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=88080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:20:10.689355 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=88081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:20:10.689662 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=88081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:20:10.689982 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=88081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:20:10.690259 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=88081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:20:10.697574 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=88080) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 19:20:10.697889 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=88080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:20:10.698171 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=88080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:20:10.698951 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=88081) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 19:20:10.699245 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=88081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:20:10.699529 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=88081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:20:10.706046 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=88080) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 19:20:10.706337 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=88080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:20:10.706631 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=88080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:20:10.706911 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=88080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:20:10.707196 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=88080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:20:10.707481 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=88080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:20:10.707576 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=88081) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 19:20:10.707755 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=88080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:20:10.707837 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=88081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:20:10.708052 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=88080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:20:10.708147 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=88081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:20:10.708325 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=88080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:20:10.708431 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=88081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:20:10.708592 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=88080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:20:10.708727 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=88081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:20:10.708871 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=88080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:20:10.708952 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=88081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:20:10.709139 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=88080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:20:10.709230 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=88081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:20:10.709403 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=88080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:20:10.709524 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=88081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:20:10.709672 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=88080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:20:10.709759 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=88081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:20:10.710006 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=88081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:20:10.710283 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=88081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:20:10.710557 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=88081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:20:10.710830 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=88081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:20:10.711097 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=88081) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 19:20:10.743099 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55e0efefb9c0 pid: 88080 (default app) Sep 24 19:20:10.744526 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55e0efefb9c0 pid: 88081 (default app) Sep 24 19:20:10.746896 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d9f372-ec69-4c0a-8d14-a134ce634595 None None] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:10.747190 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d9f372-ec69-4c0a-8d14-a134ce634595 None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:10.747461 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d9f372-ec69-4c0a-8d14-a134ce634595 None None] PATH_INFO: `/v3` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:10.751566 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 1/1] 10.222.0.18 () {50 vars in 791 bytes} [Sat Sep 24 19:20:10 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:20:18.125818 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e483d01-7e84-49fe-b476-fe876fb861db None None] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:18.126338 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e483d01-7e84-49fe-b476-fe876fb861db None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:18.126419 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e483d01-7e84-49fe-b476-fe876fb861db None None] PATH_INFO: `/` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:18.130607 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 1/2] 10.222.0.18 () {54 vars in 927 bytes} [Sat Sep 24 19:20:18 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 24 19:20:18.136569 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9388c9b-04b7-4095-a3c3-71dac0a75a77 None None] REQUEST_METHOD: `POST` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:18.137135 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9388c9b-04b7-4095-a3c3-71dac0a75a77 None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:18.137135 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9388c9b-04b7-4095-a3c3-71dac0a75a77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:18.214591 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: INFO dbcounter [None req-a9388c9b-04b7-4095-a3c3-71dac0a75a77 None None] Registered counter for database keystone Sep 24 19:20:18.235630 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG oslo_db.sqlalchemy.engines [None req-a9388c9b-04b7-4095-a3c3-71dac0a75a77 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88080) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 24 19:20:18.242125 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writer thread running {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 24 19:20:18.425750 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG passlib.handlers.bcrypt [None req-a9388c9b-04b7-4095-a3c3-71dac0a75a77 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=88080) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 24 19:20:18.426078 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG passlib.handlers.bcrypt [None req-a9388c9b-04b7-4095-a3c3-71dac0a75a77 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=88080) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 24 19:20:18.484198 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.auth.core [None req-a9388c9b-04b7-4095-a3c3-71dac0a75a77 None None] MFA Rules not processed for user `3dbbb9909cec43ff99c1c3682f016ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=88080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:20:18.485781 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.fernet_utils [None req-a9388c9b-04b7-4095-a3c3-71dac0a75a77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:20:18.614493 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 2/3] 10.222.0.18 () {58 vars in 1024 bytes} [Sat Sep 24 19:20:18 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 479 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Sep 24 19:20:19.115066 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e483d01-7e84-49fe-b476-fe876fb861db None None] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:20:19.189479 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: INFO dbcounter [None req-5e483d01-7e84-49fe-b476-fe876fb861db None None] Registered counter for database keystone Sep 24 19:20:19.212321 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG oslo_db.sqlalchemy.engines [None req-5e483d01-7e84-49fe-b476-fe876fb861db None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88081) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 24 19:20:19.218643 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writer thread running {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 24 19:20:19.337938 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e483d01-7e84-49fe-b476-fe876fb861db None None] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:20:19.342144 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2147bc-abf6-4907-8e57-eb06496ecc1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fc67bd325c24a418945f738b4bd5c71', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:20:19.342758 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2147bc-abf6-4907-8e57-eb06496ecc1b admin admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:19.343034 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2147bc-abf6-4907-8e57-eb06496ecc1b admin admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:19.343298 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2147bc-abf6-4907-8e57-eb06496ecc1b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:19.351556 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2147bc-abf6-4907-8e57-eb06496ecc1b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:20:19.402805 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: WARNING keystone.common.rbac_enforcer.enforcer [None req-4e2147bc-abf6-4907-8e57-eb06496ecc1b admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 24 19:20:19.403068 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2147bc-abf6-4907-8e57-eb06496ecc1b admin admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:20:19.413126 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 2/4] 10.222.0.18 () {58 vars in 1324 bytes} [Sat Sep 24 19:20:19 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 24 19:20:19.419064 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9388c9b-04b7-4095-a3c3-71dac0a75a77 None None] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:20:19.436249 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9388c9b-04b7-4095-a3c3-71dac0a75a77 None None] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:20:19.440693 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a521adb-6064-494b-bb47-7988017d4a44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fc67bd325c24a418945f738b4bd5c71', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:20:19.441793 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a521adb-6064-494b-bb47-7988017d4a44 admin admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:19.442106 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a521adb-6064-494b-bb47-7988017d4a44 admin admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:19.442377 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a521adb-6064-494b-bb47-7988017d4a44 admin admin] PATH_INFO: `/v3/projects/9fc67bd325c24a418945f738b4bd5c71` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:19.446754 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a521adb-6064-494b-bb47-7988017d4a44 admin admin] RBAC: Authorizing `identity:get_project(project_id=9fc67bd325c24a418945f738b4bd5c71)` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:20:19.496787 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: WARNING keystone.common.rbac_enforcer.enforcer [None req-2a521adb-6064-494b-bb47-7988017d4a44 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 24 19:20:19.497126 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a521adb-6064-494b-bb47-7988017d4a44 admin admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:20:19.501723 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 3/5] 10.222.0.18 () {56 vars in 1207 bytes} [Sat Sep 24 19:20:19 2022] GET /identity/v3/projects/9fc67bd325c24a418945f738b4bd5c71 => generated 344 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:20:21.876670 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b565e43-1781-42a3-879e-41730ca0bf01 None None] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:21.877229 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b565e43-1781-42a3-879e-41730ca0bf01 None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:21.877229 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b565e43-1781-42a3-879e-41730ca0bf01 None None] PATH_INFO: `/` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:21.881289 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 3/6] 10.222.0.18 () {54 vars in 927 bytes} [Sat Sep 24 19:20:21 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:20:21.887596 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1527d9-20c9-4ebd-9b90-3e5a9934b80b None None] REQUEST_METHOD: `POST` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:21.888049 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1527d9-20c9-4ebd-9b90-3e5a9934b80b None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:21.888200 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1527d9-20c9-4ebd-9b90-3e5a9934b80b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:21.908421 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.auth.core [None req-1e1527d9-20c9-4ebd-9b90-3e5a9934b80b None None] MFA Rules not processed for user `3dbbb9909cec43ff99c1c3682f016ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=88080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:20:21.909954 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.fernet_utils [None req-1e1527d9-20c9-4ebd-9b90-3e5a9934b80b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:20:21.917693 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 4/7] 10.222.0.18 () {58 vars in 1024 bytes} [Sat Sep 24 19:20:21 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 24 19:20:22.234566 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b565e43-1781-42a3-879e-41730ca0bf01 None None] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:20:22.247410 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b565e43-1781-42a3-879e-41730ca0bf01 None None] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:20:22.251589 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d6c9ff-055f-4100-9457-f2b790edd546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fc67bd325c24a418945f738b4bd5c71', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:20:22.252185 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d6c9ff-055f-4100-9457-f2b790edd546 admin admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:22.252464 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d6c9ff-055f-4100-9457-f2b790edd546 admin admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:22.252733 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d6c9ff-055f-4100-9457-f2b790edd546 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:22.261090 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d6c9ff-055f-4100-9457-f2b790edd546 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:20:22.262895 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d6c9ff-055f-4100-9457-f2b790edd546 admin admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:20:22.271821 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 4/8] 10.222.0.18 () {58 vars in 1324 bytes} [Sat Sep 24 19:20:22 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 24 19:20:22.277619 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1527d9-20c9-4ebd-9b90-3e5a9934b80b None None] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:20:22.286788 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1527d9-20c9-4ebd-9b90-3e5a9934b80b None None] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:20:22.291154 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e4a186-f5be-43bc-80cd-ca3e8f472e63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fc67bd325c24a418945f738b4bd5c71', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:20:22.291772 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e4a186-f5be-43bc-80cd-ca3e8f472e63 admin admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:22.292051 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e4a186-f5be-43bc-80cd-ca3e8f472e63 admin admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:22.292322 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e4a186-f5be-43bc-80cd-ca3e8f472e63 admin admin] PATH_INFO: `/v3/users/3dbbb9909cec43ff99c1c3682f016ef8` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:22.293613 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e4a186-f5be-43bc-80cd-ca3e8f472e63 admin admin] RBAC: Authorizing `identity:get_user(user_id=3dbbb9909cec43ff99c1c3682f016ef8)` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:20:22.295474 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e4a186-f5be-43bc-80cd-ca3e8f472e63 admin admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:20:22.297162 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 5/9] 10.222.0.18 () {56 vars in 1198 bytes} [Sat Sep 24 19:20:22 2022] GET /identity/v3/users/3dbbb9909cec43ff99c1c3682f016ef8 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:20:24.757226 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a41270e-c817-4575-bab5-7902d9c2e6f3 None None] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:24.757759 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a41270e-c817-4575-bab5-7902d9c2e6f3 None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:24.757759 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a41270e-c817-4575-bab5-7902d9c2e6f3 None None] PATH_INFO: `/` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:24.759179 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 5/10] 10.222.0.18 () {54 vars in 927 bytes} [Sat Sep 24 19:20:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 24 19:20:24.764537 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88809841-9fa8-43a5-945e-26f2dfd5cca1 None None] REQUEST_METHOD: `POST` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:24.764960 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88809841-9fa8-43a5-945e-26f2dfd5cca1 None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:24.765077 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88809841-9fa8-43a5-945e-26f2dfd5cca1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:24.783754 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.auth.core [None req-88809841-9fa8-43a5-945e-26f2dfd5cca1 None None] MFA Rules not processed for user `3dbbb9909cec43ff99c1c3682f016ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=88080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:20:24.784945 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.fernet_utils [None req-88809841-9fa8-43a5-945e-26f2dfd5cca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:20:24.806076 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45684db8-3712-4fd5-98b4-037110bd0616 None None] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:24.806368 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45684db8-3712-4fd5-98b4-037110bd0616 None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:24.806642 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45684db8-3712-4fd5-98b4-037110bd0616 None None] PATH_INFO: `/` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:24.807947 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 6/11] 10.222.0.18 () {54 vars in 927 bytes} [Sat Sep 24 19:20:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 24 19:20:24.813227 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c7f96b-83a6-47cd-bc20-a6d783d330f2 None None] REQUEST_METHOD: `POST` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:24.813507 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c7f96b-83a6-47cd-bc20-a6d783d330f2 None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:24.813778 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c7f96b-83a6-47cd-bc20-a6d783d330f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:24.856398 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG passlib.handlers.bcrypt [None req-82c7f96b-83a6-47cd-bc20-a6d783d330f2 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=88081) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 24 19:20:24.856791 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG passlib.handlers.bcrypt [None req-82c7f96b-83a6-47cd-bc20-a6d783d330f2 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=88081) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 24 19:20:24.869391 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 6/12] 10.222.0.18 () {58 vars in 1024 bytes} [Sat Sep 24 19:20:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:20:24.907333 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.auth.core [None req-82c7f96b-83a6-47cd-bc20-a6d783d330f2 None None] MFA Rules not processed for user `3dbbb9909cec43ff99c1c3682f016ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=88081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:20:24.908935 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.fernet_utils [None req-82c7f96b-83a6-47cd-bc20-a6d783d330f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:20:25.009639 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 7/13] 10.222.0.18 () {58 vars in 1024 bytes} [Sat Sep 24 19:20:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 24 19:20:25.190711 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88809841-9fa8-43a5-945e-26f2dfd5cca1 None None] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:20:25.327525 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:20:25.333308 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c7f96b-83a6-47cd-bc20-a6d783d330f2 None None] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:20:25.411161 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88809841-9fa8-43a5-945e-26f2dfd5cca1 None None] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:20:25.435782 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c7f96b-83a6-47cd-bc20-a6d783d330f2 None None] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:20:25.438054 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:20:25.447344 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc0e7f0-f86d-4b9b-a77f-896a474b28fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:20:25.447973 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc0e7f0-f86d-4b9b-a77f-896a474b28fe None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:25.448252 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc0e7f0-f86d-4b9b-a77f-896a474b28fe None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:25.448523 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc0e7f0-f86d-4b9b-a77f-896a474b28fe None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:25.461576 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc0e7f0-f86d-4b9b-a77f-896a474b28fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:20:25.470347 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application [None req-9bc0e7f0-f86d-4b9b-a77f-896a474b28fe None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 19:20:25.470347 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:20:25.470347 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:20:25.470347 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:20:25.470347 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:20:25.470347 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:20:25.470347 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:20:25.470347 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:20:25.470347 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:20:25.470347 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:20:25.470347 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:20:25.470347 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:20:25.470347 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:20:25.470347 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:20:25.470347 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:20:25.470347 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:20:25.471432 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:20:25.471432 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:20:25.471432 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:20:25.471432 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:20:25.471432 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:20:25.471432 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:20:25.471432 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:20:25.471432 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:20:25.471432 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:20:25.471432 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:20:25.471432 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:20:25.471432 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application with Lock( Sep 24 19:20:25.471432 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:20:25.471432 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:20:25.471432 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:20:25.471432 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:20:25.472753 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:20:25.472753 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:20:25.472753 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:20:25.472753 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:20:25.472753 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:20:25.472753 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:20:25.472753 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:20:25.472753 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:20:25.472753 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:20:25.472753 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:20:25.472753 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 19:20:25.472753 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Sep 24 19:20:25.472753 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 7/14] 10.222.0.18 () {56 vars in 1096 bytes} [Sat Sep 24 19:20:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:20:25.475227 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8afbbdb-67ad-480d-aab1-97b9a8e83ee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:20:25.476089 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8afbbdb-67ad-480d-aab1-97b9a8e83ee6 None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:25.477233 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8afbbdb-67ad-480d-aab1-97b9a8e83ee6 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:25.477509 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8afbbdb-67ad-480d-aab1-97b9a8e83ee6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:25.477770 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc0e7f0-f86d-4b9b-a77f-896a474b28fe None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:20:25.544717 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8afbbdb-67ad-480d-aab1-97b9a8e83ee6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:20:25.546258 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8afbbdb-67ad-480d-aab1-97b9a8e83ee6 None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:20:25.562683 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:20:25.581680 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc0e7f0-f86d-4b9b-a77f-896a474b28fe None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:20:25.617436 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeabb240-02e7-4c38-872a-40cfe35b6135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:20:25.618372 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeabb240-02e7-4c38-872a-40cfe35b6135 None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:25.618759 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeabb240-02e7-4c38-872a-40cfe35b6135 None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:25.619030 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeabb240-02e7-4c38-872a-40cfe35b6135 None admin] PATH_INFO: `/v3/roles` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:25.619950 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeabb240-02e7-4c38-872a-40cfe35b6135 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:20:25.620245 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeabb240-02e7-4c38-872a-40cfe35b6135 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:20:25.621623 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeabb240-02e7-4c38-872a-40cfe35b6135 None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:20:25.634084 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 8/15] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Sep 24 19:20:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:20:25.640057 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeabb240-02e7-4c38-872a-40cfe35b6135 None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:20:25.650305 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 8/16] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Sep 24 19:20:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 24 19:20:25.655976 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8afbbdb-67ad-480d-aab1-97b9a8e83ee6 None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:20:25.658907 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:20:25.742629 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeabb240-02e7-4c38-872a-40cfe35b6135 None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:20:25.754565 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8afbbdb-67ad-480d-aab1-97b9a8e83ee6 None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:20:25.776779 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ed2da7-a930-453e-b562-4c05a23c3fdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:20:25.777411 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ed2da7-a930-453e-b562-4c05a23c3fdb None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:25.777683 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ed2da7-a930-453e-b562-4c05a23c3fdb None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:25.777986 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ed2da7-a930-453e-b562-4c05a23c3fdb None admin] PATH_INFO: `/v3/users/3dbbb9909cec43ff99c1c3682f016ef8` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:25.779135 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ed2da7-a930-453e-b562-4c05a23c3fdb None admin] RBAC: Authorizing `identity:get_user(user_id=3dbbb9909cec43ff99c1c3682f016ef8)` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:20:25.780586 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ed2da7-a930-453e-b562-4c05a23c3fdb None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:20:25.782182 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 9/17] 10.222.0.18 () {56 vars in 1177 bytes} [Sat Sep 24 19:20:25 2022] GET /identity/v3/users/3dbbb9909cec43ff99c1c3682f016ef8 => generated 247 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:20:25.787558 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ed2da7-a930-453e-b562-4c05a23c3fdb None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:20:25.794308 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495f329b-ec22-4864-a99d-81fa519c191f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:20:25.795174 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495f329b-ec22-4864-a99d-81fa519c191f None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:25.795457 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495f329b-ec22-4864-a99d-81fa519c191f None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:25.795734 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495f329b-ec22-4864-a99d-81fa519c191f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:25.802733 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:20:25.816359 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495f329b-ec22-4864-a99d-81fa519c191f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:20:25.817853 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495f329b-ec22-4864-a99d-81fa519c191f None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:20:25.838790 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application [None req-495f329b-ec22-4864-a99d-81fa519c191f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:20:25.838790 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:20:25.838790 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:20:25.838790 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:20:25.838790 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:20:25.838790 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:20:25.838790 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:20:25.838790 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:20:25.838790 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:20:25.838790 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:20:25.838790 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:20:25.838790 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:20:25.838790 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:20:25.838790 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:20:25.838790 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:20:25.838790 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:20:25.839845 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:20:25.839845 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:20:25.839845 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:20:25.839845 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:20:25.839845 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:20:25.839845 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:20:25.839845 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:20:25.839845 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application with Lock( Sep 24 19:20:25.839845 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:20:25.839845 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:20:25.839845 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:20:25.839845 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:20:25.839845 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:20:25.839845 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:20:25.839845 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:20:25.839845 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:20:25.839845 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:20:25.840648 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:20:25.840648 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:20:25.840648 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Sep 24 19:20:25.840648 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 9/18] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Sep 24 19:20:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 19:20:25.845571 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495f329b-ec22-4864-a99d-81fa519c191f None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:20:25.893153 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ed2da7-a930-453e-b562-4c05a23c3fdb None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:20:25.930491 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6616f50-94b0-4241-a6fb-b8be1d8e4758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:20:25.931147 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6616f50-94b0-4241-a6fb-b8be1d8e4758 None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:25.931444 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6616f50-94b0-4241-a6fb-b8be1d8e4758 None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:25.931830 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6616f50-94b0-4241-a6fb-b8be1d8e4758 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:25.933053 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6616f50-94b0-4241-a6fb-b8be1d8e4758 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:20:25.934565 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6616f50-94b0-4241-a6fb-b8be1d8e4758 None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:20:25.936232 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 10/19] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Sep 24 19:20:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:20:25.943760 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6616f50-94b0-4241-a6fb-b8be1d8e4758 None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:20:26.012364 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:20:26.028600 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:20:26.048146 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6616f50-94b0-4241-a6fb-b8be1d8e4758 None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:20:26.057020 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495f329b-ec22-4864-a99d-81fa519c191f None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:20:26.083071 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6783c664-e48f-476f-bca6-6291d09a621c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:20:26.083843 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6783c664-e48f-476f-bca6-6291d09a621c None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:26.084124 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6783c664-e48f-476f-bca6-6291d09a621c None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:26.084396 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6783c664-e48f-476f-bca6-6291d09a621c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:26.085144 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6783c664-e48f-476f-bca6-6291d09a621c None admin] RBAC: Adding query filter params (role.id=4c7d0dafc19b4b0a9821be6ec0da0a8f, scope.domain.id=default, user.id=3dbbb9909cec43ff99c1c3682f016ef8) {{(pid=88080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:20:26.085465 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6783c664-e48f-476f-bca6-6291d09a621c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:20:26.087059 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6783c664-e48f-476f-bca6-6291d09a621c None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:20:26.109928 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 11/20] 10.222.0.18 () {56 vars in 1322 bytes} [Sat Sep 24 19:20:25 2022] GET /identity/v3/role_assignments?user.id=3dbbb9909cec43ff99c1c3682f016ef8&scope.domain.id=default&role.id=4c7d0dafc19b4b0a9821be6ec0da0a8f => generated 233 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:20:26.110129 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619df0d6-79e4-4701-9ed3-020515ee4030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:20:26.110129 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619df0d6-79e4-4701-9ed3-020515ee4030 None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:26.110129 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619df0d6-79e4-4701-9ed3-020515ee4030 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:26.110129 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619df0d6-79e4-4701-9ed3-020515ee4030 None admin] PATH_INFO: `/v3/domains` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:26.110457 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619df0d6-79e4-4701-9ed3-020515ee4030 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:20:26.110457 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619df0d6-79e4-4701-9ed3-020515ee4030 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:20:26.110457 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619df0d6-79e4-4701-9ed3-020515ee4030 None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:20:26.129148 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 10/21] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Sep 24 19:20:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:20:29.031355 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22abf023-52cd-49ed-969e-db88e80dd2fa None None] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:29.031847 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22abf023-52cd-49ed-969e-db88e80dd2fa None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:29.031847 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22abf023-52cd-49ed-969e-db88e80dd2fa None None] PATH_INFO: `/` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:29.033389 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 12/22] 10.222.0.18 () {54 vars in 927 bytes} [Sat Sep 24 19:20:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:20:29.038698 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0317ba0-fd6e-4429-83df-e4019d827c9a None None] REQUEST_METHOD: `POST` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:29.039206 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0317ba0-fd6e-4429-83df-e4019d827c9a None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:29.039383 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0317ba0-fd6e-4429-83df-e4019d827c9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:29.064487 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.auth.core [None req-c0317ba0-fd6e-4429-83df-e4019d827c9a None None] MFA Rules not processed for user `3dbbb9909cec43ff99c1c3682f016ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=88081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:20:29.065681 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.fernet_utils [None req-c0317ba0-fd6e-4429-83df-e4019d827c9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:20:29.164663 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7734a47-7591-44c0-9b2c-66dfd6d756cc None None] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:29.165084 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7734a47-7591-44c0-9b2c-66dfd6d756cc None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:29.165183 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7734a47-7591-44c0-9b2c-66dfd6d756cc None None] PATH_INFO: `/` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:29.166868 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 13/23] 10.222.0.18 () {54 vars in 927 bytes} [Sat Sep 24 19:20:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 24 19:20:29.167097 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 11/24] 10.222.0.18 () {58 vars in 1024 bytes} [Sat Sep 24 19:20:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:20:29.184236 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad2fe84-d420-475d-a229-a865a38836d9 None None] REQUEST_METHOD: `POST` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:29.184531 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad2fe84-d420-475d-a229-a865a38836d9 None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:29.184779 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad2fe84-d420-475d-a229-a865a38836d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:29.223315 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.auth.core [None req-8ad2fe84-d420-475d-a229-a865a38836d9 None None] MFA Rules not processed for user `3dbbb9909cec43ff99c1c3682f016ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=88080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:20:29.224506 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.fernet_utils [None req-8ad2fe84-d420-475d-a229-a865a38836d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:20:29.319235 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 14/25] 10.222.0.18 () {58 vars in 1024 bytes} [Sat Sep 24 19:20:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 24 19:20:29.396402 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e18876-dd79-4ce1-ad04-bf16ae639044 None None] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:29.397044 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e18876-dd79-4ce1-ad04-bf16ae639044 None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:29.397517 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e18876-dd79-4ce1-ad04-bf16ae639044 None None] PATH_INFO: `/` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:29.399419 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 12/26] 10.222.0.18 () {54 vars in 927 bytes} [Sat Sep 24 19:20:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:20:29.404961 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39ee0fc-57aa-419c-b0ed-33e4a81ba902 None None] REQUEST_METHOD: `POST` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:29.405513 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39ee0fc-57aa-419c-b0ed-33e4a81ba902 None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:29.406032 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39ee0fc-57aa-419c-b0ed-33e4a81ba902 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:29.434497 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.auth.core [None req-e39ee0fc-57aa-419c-b0ed-33e4a81ba902 None None] MFA Rules not processed for user `3dbbb9909cec43ff99c1c3682f016ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=88080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:20:29.436038 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.fernet_utils [None req-e39ee0fc-57aa-419c-b0ed-33e4a81ba902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:20:29.510105 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 15/27] 10.222.0.18 () {58 vars in 1024 bytes} [Sat Sep 24 19:20:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 24 19:20:29.753126 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e18876-dd79-4ce1-ad04-bf16ae639044 None None] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:20:29.812728 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:20:29.855075 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39ee0fc-57aa-419c-b0ed-33e4a81ba902 None None] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:20:29.858713 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:20:29.923254 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e18876-dd79-4ce1-ad04-bf16ae639044 None None] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:20:30.003567 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac1aadc-ba02-4f7b-a4b3-2836d1fa4433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:20:30.004191 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac1aadc-ba02-4f7b-a4b3-2836d1fa4433 None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:30.004472 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac1aadc-ba02-4f7b-a4b3-2836d1fa4433 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:30.004743 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac1aadc-ba02-4f7b-a4b3-2836d1fa4433 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:30.039027 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39ee0fc-57aa-419c-b0ed-33e4a81ba902 None None] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:20:30.040612 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac1aadc-ba02-4f7b-a4b3-2836d1fa4433 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:20:30.047632 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application [None req-fac1aadc-ba02-4f7b-a4b3-2836d1fa4433 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 19:20:30.047632 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:20:30.047632 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:20:30.047632 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:20:30.047632 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:20:30.047632 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:20:30.047632 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:20:30.047632 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:20:30.047632 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:20:30.047632 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:20:30.047632 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:20:30.047632 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:20:30.047632 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:20:30.047632 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:20:30.047632 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:20:30.047632 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:20:30.048567 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:20:30.048567 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:20:30.048567 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:20:30.048567 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:20:30.048567 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:20:30.048567 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:20:30.048567 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:20:30.048567 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:20:30.048567 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:20:30.048567 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:20:30.048567 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:20:30.048567 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application with Lock( Sep 24 19:20:30.048567 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:20:30.048567 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:20:30.048567 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:20:30.048567 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:20:30.049592 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:20:30.049592 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:20:30.049592 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:20:30.049592 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:20:30.049592 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:20:30.049592 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:20:30.049592 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:20:30.049592 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:20:30.049592 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:20:30.049592 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:20:30.049592 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 19:20:30.049592 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Sep 24 19:20:30.049592 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 13/28] 10.222.0.18 () {56 vars in 1096 bytes} [Sat Sep 24 19:20:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:20:30.053222 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac1aadc-ba02-4f7b-a4b3-2836d1fa4433 None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:20:30.086798 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b907c97-6a93-4f84-a835-474fbcbe597e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:20:30.087444 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b907c97-6a93-4f84-a835-474fbcbe597e None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:30.087725 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b907c97-6a93-4f84-a835-474fbcbe597e None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:30.088053 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b907c97-6a93-4f84-a835-474fbcbe597e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:30.104819 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b907c97-6a93-4f84-a835-474fbcbe597e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:20:30.106335 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b907c97-6a93-4f84-a835-474fbcbe597e None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:20:30.125384 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application [None req-5b907c97-6a93-4f84-a835-474fbcbe597e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:20:30.125384 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:20:30.125384 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:20:30.125384 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:20:30.125384 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:20:30.125384 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:20:30.125384 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:20:30.125384 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:20:30.125384 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:20:30.125384 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:20:30.125384 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:20:30.125384 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:20:30.125384 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:20:30.125384 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:20:30.125384 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:20:30.125384 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:20:30.126524 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:20:30.126524 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:20:30.126524 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:20:30.126524 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:20:30.126524 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:20:30.126524 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:20:30.126524 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:20:30.126524 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application with Lock( Sep 24 19:20:30.126524 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:20:30.126524 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:20:30.126524 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:20:30.126524 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:20:30.126524 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:20:30.126524 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:20:30.126524 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:20:30.126524 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:20:30.126524 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:20:30.127528 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:20:30.127528 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:20:30.127528 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Sep 24 19:20:30.129262 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 16/29] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Sep 24 19:20:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 19:20:30.130296 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b907c97-6a93-4f84-a835-474fbcbe597e None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:20:30.187551 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac1aadc-ba02-4f7b-a4b3-2836d1fa4433 None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:20:30.197258 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:20:30.201630 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:20:30.229586 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcd221d-60de-4000-abef-b277fc0076ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:20:30.230226 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcd221d-60de-4000-abef-b277fc0076ea None admin] REQUEST_METHOD: `POST` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:30.230670 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcd221d-60de-4000-abef-b277fc0076ea None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:30.231216 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcd221d-60de-4000-abef-b277fc0076ea None admin] PATH_INFO: `/v3/roles` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:30.232044 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcd221d-60de-4000-abef-b277fc0076ea None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:20:30.233666 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcd221d-60de-4000-abef-b277fc0076ea None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:20:30.270297 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b907c97-6a93-4f84-a835-474fbcbe597e None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:20:30.310183 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5bbe87-c415-4730-bd2f-ae6893ccd267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:20:30.311068 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5bbe87-c415-4730-bd2f-ae6893ccd267 None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:30.311487 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5bbe87-c415-4730-bd2f-ae6893ccd267 None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:30.311991 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5bbe87-c415-4730-bd2f-ae6893ccd267 None admin] PATH_INFO: `/v3/roles` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:30.312799 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5bbe87-c415-4730-bd2f-ae6893ccd267 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:20:30.313296 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5bbe87-c415-4730-bd2f-ae6893ccd267 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:20:30.314930 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5bbe87-c415-4730-bd2f-ae6893ccd267 None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:20:30.324983 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 17/30] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Sep 24 19:20:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:20:30.326270 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5bbe87-c415-4730-bd2f-ae6893ccd267 None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:20:30.385464 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 14/31] 10.222.0.18 () {60 vars in 1131 bytes} [Sat Sep 24 19:20:30 2022] POST /identity/v3/roles => generated 219 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:20:30.387416 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9279a3-c4d5-471c-b8e1-9cfe725450eb None None] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:30.387717 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9279a3-c4d5-471c-b8e1-9cfe725450eb None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:30.388000 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9279a3-c4d5-471c-b8e1-9cfe725450eb None None] PATH_INFO: `/` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:30.389776 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 15/32] 10.222.0.18 () {54 vars in 927 bytes} [Sat Sep 24 19:20:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:20:30.390703 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9279a3-c4d5-471c-b8e1-9cfe725450eb None None] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:20:30.470256 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5bbe87-c415-4730-bd2f-ae6893ccd267 None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:20:30.494137 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:20:30.518086 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8a5099-fa65-45e2-80ad-ceccfd22388a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:20:30.519225 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8a5099-fa65-45e2-80ad-ceccfd22388a None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:30.519653 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8a5099-fa65-45e2-80ad-ceccfd22388a None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:30.520368 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8a5099-fa65-45e2-80ad-ceccfd22388a None admin] PATH_INFO: `/v3/domains` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:30.521414 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8a5099-fa65-45e2-80ad-ceccfd22388a None admin] RBAC: Adding query filter params (name=Default) {{(pid=88080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:20:30.522158 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8a5099-fa65-45e2-80ad-ceccfd22388a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:20:30.524567 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8a5099-fa65-45e2-80ad-ceccfd22388a None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:20:30.548544 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 18/33] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Sep 24 19:20:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:20:30.550575 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4aeb94-2b8a-4bd2-805a-a01ef95ba5f0 None None] REQUEST_METHOD: `POST` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:30.551017 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4aeb94-2b8a-4bd2-805a-a01ef95ba5f0 None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:30.551466 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4aeb94-2b8a-4bd2-805a-a01ef95ba5f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:30.574750 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.auth.core [None req-6a4aeb94-2b8a-4bd2-805a-a01ef95ba5f0 None None] MFA Rules not processed for user `3dbbb9909cec43ff99c1c3682f016ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=88080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:20:30.577370 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.fernet_utils [None req-6a4aeb94-2b8a-4bd2-805a-a01ef95ba5f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:20:30.640145 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9279a3-c4d5-471c-b8e1-9cfe725450eb None None] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:20:30.666765 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 19/34] 10.222.0.18 () {58 vars in 1024 bytes} [Sat Sep 24 19:20:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:20:30.668074 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4aeb94-2b8a-4bd2-805a-a01ef95ba5f0 None None] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:20:30.777030 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3146c53c-948a-4e60-b31d-79855e8af97b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:20:30.777030 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3146c53c-948a-4e60-b31d-79855e8af97b None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:30.777030 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3146c53c-948a-4e60-b31d-79855e8af97b None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:30.777030 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3146c53c-948a-4e60-b31d-79855e8af97b None admin] PATH_INFO: `/v3/users/3dbbb9909cec43ff99c1c3682f016ef8` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:30.777401 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3146c53c-948a-4e60-b31d-79855e8af97b None admin] RBAC: Authorizing `identity:get_user(user_id=3dbbb9909cec43ff99c1c3682f016ef8)` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:20:30.778966 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3146c53c-948a-4e60-b31d-79855e8af97b None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:20:30.781012 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 16/35] 10.222.0.18 () {56 vars in 1177 bytes} [Sat Sep 24 19:20:30 2022] GET /identity/v3/users/3dbbb9909cec43ff99c1c3682f016ef8 => generated 247 bytes in 390 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:20:30.788365 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3146c53c-948a-4e60-b31d-79855e8af97b None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:20:30.846230 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:20:30.855405 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4aeb94-2b8a-4bd2-805a-a01ef95ba5f0 None None] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:20:30.868355 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:20:30.903576 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5164d10-ac0c-4e00-860a-34bb6f360a27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:20:30.904347 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5164d10-ac0c-4e00-860a-34bb6f360a27 None admin] REQUEST_METHOD: `POST` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:30.904647 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5164d10-ac0c-4e00-860a-34bb6f360a27 None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:30.904918 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5164d10-ac0c-4e00-860a-34bb6f360a27 None admin] PATH_INFO: `/v3/projects` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:30.905576 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5164d10-ac0c-4e00-860a-34bb6f360a27 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:20:30.907431 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5164d10-ac0c-4e00-860a-34bb6f360a27 None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:20:30.933104 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3146c53c-948a-4e60-b31d-79855e8af97b None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:20:30.971373 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a4b17e-c5a9-475c-9e4f-7035c5546d5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:20:30.972005 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a4b17e-c5a9-475c-9e4f-7035c5546d5d None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:30.972336 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a4b17e-c5a9-475c-9e4f-7035c5546d5d None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:30.972652 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a4b17e-c5a9-475c-9e4f-7035c5546d5d None admin] PATH_INFO: `/v3/domains/default` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:30.973889 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a4b17e-c5a9-475c-9e4f-7035c5546d5d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:20:30.975303 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a4b17e-c5a9-475c-9e4f-7035c5546d5d None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:20:30.982060 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 17/36] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Sep 24 19:20:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:20:30.982060 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486e8554-74e5-4dc8-a15a-a25e466040ab None None] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:30.982060 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486e8554-74e5-4dc8-a15a-a25e466040ab None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:30.982060 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486e8554-74e5-4dc8-a15a-a25e466040ab None None] PATH_INFO: `/` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:30.982060 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 18/37] 10.222.0.18 () {54 vars in 927 bytes} [Sat Sep 24 19:20:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:20:30.982426 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70197079-a96b-493a-ba8a-7fcf247f2e23 None None] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:30.982653 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70197079-a96b-493a-ba8a-7fcf247f2e23 None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:30.982865 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70197079-a96b-493a-ba8a-7fcf247f2e23 None None] PATH_INFO: `/` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:30.988573 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 19/38] 10.222.0.18 () {54 vars in 927 bytes} [Sat Sep 24 19:20:30 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:20:30.989335 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70197079-a96b-493a-ba8a-7fcf247f2e23 None None] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:20:31.055628 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 20/39] 10.222.0.18 () {60 vars in 1141 bytes} [Sat Sep 24 19:20:30 2022] POST /identity/v3/projects => generated 301 bytes in 388 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:20:31.056921 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d76238-9b94-4fdf-8c5f-7b9476944964 None None] REQUEST_METHOD: `POST` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:31.057212 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d76238-9b94-4fdf-8c5f-7b9476944964 None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:31.057493 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d76238-9b94-4fdf-8c5f-7b9476944964 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:31.080656 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.auth.core [None req-e3d76238-9b94-4fdf-8c5f-7b9476944964 None None] MFA Rules not processed for user `3dbbb9909cec43ff99c1c3682f016ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=88080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:20:31.083205 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.fernet_utils [None req-e3d76238-9b94-4fdf-8c5f-7b9476944964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:20:31.129158 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70197079-a96b-493a-ba8a-7fcf247f2e23 None None] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:20:31.131468 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:20:31.167627 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 21/40] 10.222.0.18 () {58 vars in 1024 bytes} [Sat Sep 24 19:20:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:20:31.169218 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bf7393-3562-4c88-8721-58c02b1cda37 None None] REQUEST_METHOD: `POST` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:31.169494 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bf7393-3562-4c88-8721-58c02b1cda37 None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:31.169770 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bf7393-3562-4c88-8721-58c02b1cda37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:31.189817 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.auth.core [None req-a3bf7393-3562-4c88-8721-58c02b1cda37 None None] MFA Rules not processed for user `3dbbb9909cec43ff99c1c3682f016ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=88080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:20:31.191062 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.fernet_utils [None req-a3bf7393-3562-4c88-8721-58c02b1cda37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:20:31.198085 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d359fafb-1684-4fa2-a306-81853fc65755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:20:31.199750 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d359fafb-1684-4fa2-a306-81853fc65755 None admin] REQUEST_METHOD: `PUT` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:31.201525 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d359fafb-1684-4fa2-a306-81853fc65755 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:31.202384 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d359fafb-1684-4fa2-a306-81853fc65755 None admin] PATH_INFO: `/v3/domains/default/users/3dbbb9909cec43ff99c1c3682f016ef8/roles/4c7d0dafc19b4b0a9821be6ec0da0a8f` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:31.208394 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d359fafb-1684-4fa2-a306-81853fc65755 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=3dbbb9909cec43ff99c1c3682f016ef8, role_id=4c7d0dafc19b4b0a9821be6ec0da0a8f)` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:20:31.212535 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d359fafb-1684-4fa2-a306-81853fc65755 None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:20:31.241904 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 20/41] 10.222.0.18 () {58 vars in 1361 bytes} [Sat Sep 24 19:20:30 2022] PUT /identity/v3/domains/default/users/3dbbb9909cec43ff99c1c3682f016ef8/roles/4c7d0dafc19b4b0a9821be6ec0da0a8f => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:20:31.241904 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d359fafb-1684-4fa2-a306-81853fc65755 None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:20:31.321805 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 22/42] 10.222.0.18 () {58 vars in 1024 bytes} [Sat Sep 24 19:20:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:20:31.427307 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d359fafb-1684-4fa2-a306-81853fc65755 None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:20:31.471428 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708f9c1f-7812-496c-858a-b51b6bfe8615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:20:31.472059 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708f9c1f-7812-496c-858a-b51b6bfe8615 None admin] REQUEST_METHOD: `POST` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:31.472338 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708f9c1f-7812-496c-858a-b51b6bfe8615 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:31.472611 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708f9c1f-7812-496c-858a-b51b6bfe8615 None admin] PATH_INFO: `/v3/roles` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:31.473291 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708f9c1f-7812-496c-858a-b51b6bfe8615 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:20:31.474728 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708f9c1f-7812-496c-858a-b51b6bfe8615 None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:20:31.494936 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 21/43] 10.222.0.18 () {60 vars in 1131 bytes} [Sat Sep 24 19:20:31 2022] POST /identity/v3/roles => generated 225 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:20:31.537381 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bf7393-3562-4c88-8721-58c02b1cda37 None None] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:20:31.563448 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:20:31.664777 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bf7393-3562-4c88-8721-58c02b1cda37 None None] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:20:31.693079 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708f9c1f-7812-496c-858a-b51b6bfe8615 None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:20:31.709744 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b60593-a657-4c66-839a-36dbfe335d86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:20:31.711456 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b60593-a657-4c66-839a-36dbfe335d86 None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:31.712007 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b60593-a657-4c66-839a-36dbfe335d86 None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:31.712441 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b60593-a657-4c66-839a-36dbfe335d86 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:31.713793 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b60593-a657-4c66-839a-36dbfe335d86 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:20:31.715848 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b60593-a657-4c66-839a-36dbfe335d86 None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:20:31.718081 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 23/44] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Sep 24 19:20:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:20:31.724997 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b60593-a657-4c66-839a-36dbfe335d86 None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:20:31.727465 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:20:31.826978 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708f9c1f-7812-496c-858a-b51b6bfe8615 None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:20:31.833219 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:20:31.846902 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b60593-a657-4c66-839a-36dbfe335d86 None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:20:31.868953 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4504d975-a0c2-443e-9907-eee0e69f279d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:20:31.870070 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4504d975-a0c2-443e-9907-eee0e69f279d None admin] REQUEST_METHOD: `POST` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:31.870352 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4504d975-a0c2-443e-9907-eee0e69f279d None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:31.870739 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4504d975-a0c2-443e-9907-eee0e69f279d None admin] PATH_INFO: `/v3/roles` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:31.871297 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4504d975-a0c2-443e-9907-eee0e69f279d None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:20:31.872679 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4504d975-a0c2-443e-9907-eee0e69f279d None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:20:31.885086 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea324ff4-21e2-406b-a1dd-49300ef51e69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:20:31.885698 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea324ff4-21e2-406b-a1dd-49300ef51e69 None admin] REQUEST_METHOD: `POST` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:31.886007 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea324ff4-21e2-406b-a1dd-49300ef51e69 None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:31.886279 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea324ff4-21e2-406b-a1dd-49300ef51e69 None admin] PATH_INFO: `/v3/projects` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:31.886927 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea324ff4-21e2-406b-a1dd-49300ef51e69 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:20:31.888368 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea324ff4-21e2-406b-a1dd-49300ef51e69 None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:20:31.888839 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 22/45] 10.222.0.18 () {60 vars in 1131 bytes} [Sat Sep 24 19:20:31 2022] POST /identity/v3/roles => generated 223 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 24 19:20:31.919719 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 24/46] 10.222.0.18 () {60 vars in 1141 bytes} [Sat Sep 24 19:20:31 2022] POST /identity/v3/projects => generated 312 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 24 19:20:33.766640 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ca48d0-b994-4604-a35c-d6436038588a None None] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:33.767040 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ca48d0-b994-4604-a35c-d6436038588a None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:33.767196 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ca48d0-b994-4604-a35c-d6436038588a None None] PATH_INFO: `/` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:33.768524 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 23/47] 10.222.0.18 () {54 vars in 927 bytes} [Sat Sep 24 19:20:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:20:33.774294 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664ab251-b2ea-4c2e-8934-008eb24493fc None None] REQUEST_METHOD: `POST` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:33.774703 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664ab251-b2ea-4c2e-8934-008eb24493fc None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:33.774836 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664ab251-b2ea-4c2e-8934-008eb24493fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:33.793740 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.auth.core [None req-664ab251-b2ea-4c2e-8934-008eb24493fc None None] MFA Rules not processed for user `3dbbb9909cec43ff99c1c3682f016ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=88080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:20:33.794945 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.fernet_utils [None req-664ab251-b2ea-4c2e-8934-008eb24493fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:20:33.862737 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 25/48] 10.222.0.18 () {58 vars in 1024 bytes} [Sat Sep 24 19:20:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:20:34.177724 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ca48d0-b994-4604-a35c-d6436038588a None None] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:20:34.264157 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:20:34.286447 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ca48d0-b994-4604-a35c-d6436038588a None None] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:20:34.319982 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3a1eea-0417-4582-afa8-48b0e4bbe0cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:20:34.320611 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3a1eea-0417-4582-afa8-48b0e4bbe0cf None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:34.320891 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3a1eea-0417-4582-afa8-48b0e4bbe0cf None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:34.321160 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3a1eea-0417-4582-afa8-48b0e4bbe0cf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:34.332156 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3a1eea-0417-4582-afa8-48b0e4bbe0cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:20:34.337521 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application [None req-da3a1eea-0417-4582-afa8-48b0e4bbe0cf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 19:20:34.337521 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:20:34.337521 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:20:34.337521 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:20:34.337521 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:20:34.337521 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:20:34.337521 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:20:34.337521 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:20:34.337521 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:20:34.337521 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:20:34.337521 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:20:34.337521 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:20:34.337521 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:20:34.337521 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:20:34.337521 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:20:34.337521 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:20:34.338539 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:20:34.338539 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:20:34.338539 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:20:34.338539 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:20:34.338539 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:20:34.338539 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:20:34.338539 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:20:34.338539 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:20:34.338539 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:20:34.338539 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:20:34.338539 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:20:34.338539 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application with Lock( Sep 24 19:20:34.338539 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:20:34.338539 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:20:34.338539 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:20:34.338539 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:20:34.339777 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:20:34.339777 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:20:34.339777 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:20:34.339777 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:20:34.339777 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:20:34.339777 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:20:34.339777 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:20:34.339777 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:20:34.339777 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:20:34.339777 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:20:34.339777 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 19:20:34.339777 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Sep 24 19:20:34.339777 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 24/49] 10.222.0.18 () {56 vars in 1096 bytes} [Sat Sep 24 19:20:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:20:34.344426 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664ab251-b2ea-4c2e-8934-008eb24493fc None None] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:20:34.414634 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:20:34.447633 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664ab251-b2ea-4c2e-8934-008eb24493fc None None] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:20:34.469884 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b37d64-7f02-4b15-8121-4bffb05d2be4 None None] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:34.470177 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b37d64-7f02-4b15-8121-4bffb05d2be4 None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:34.470459 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b37d64-7f02-4b15-8121-4bffb05d2be4 None None] PATH_INFO: `/` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:34.471798 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 25/50] 10.222.0.18 () {54 vars in 927 bytes} [Sat Sep 24 19:20:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 24 19:20:34.477017 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea110eea-1e11-4e9c-9fba-65092fcfde13 None None] REQUEST_METHOD: `POST` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:34.477301 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea110eea-1e11-4e9c-9fba-65092fcfde13 None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:34.477580 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea110eea-1e11-4e9c-9fba-65092fcfde13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:34.481382 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b760b833-366b-4afc-9485-05f8a6e84c19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:20:34.482041 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b760b833-366b-4afc-9485-05f8a6e84c19 None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:34.482318 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b760b833-366b-4afc-9485-05f8a6e84c19 None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:34.482586 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b760b833-366b-4afc-9485-05f8a6e84c19 None admin] PATH_INFO: `/v3/roles` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:34.483271 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b760b833-366b-4afc-9485-05f8a6e84c19 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:20:34.483570 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b760b833-366b-4afc-9485-05f8a6e84c19 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:20:34.484996 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b760b833-366b-4afc-9485-05f8a6e84c19 None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:20:34.495301 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 26/51] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Sep 24 19:20:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:20:34.497949 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.auth.core [None req-ea110eea-1e11-4e9c-9fba-65092fcfde13 None None] MFA Rules not processed for user `3dbbb9909cec43ff99c1c3682f016ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=88081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:20:34.499518 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.fernet_utils [None req-ea110eea-1e11-4e9c-9fba-65092fcfde13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:20:34.501123 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b760b833-366b-4afc-9485-05f8a6e84c19 None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:20:34.578775 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 26/52] 10.222.0.18 () {58 vars in 1024 bytes} [Sat Sep 24 19:20:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 24 19:20:34.615765 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b760b833-366b-4afc-9485-05f8a6e84c19 None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:20:34.647484 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:20:34.653468 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb43dbe-3c3f-4de2-913a-42b6eac3615e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:20:34.654145 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb43dbe-3c3f-4de2-913a-42b6eac3615e None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:34.654626 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb43dbe-3c3f-4de2-913a-42b6eac3615e None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:34.655058 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb43dbe-3c3f-4de2-913a-42b6eac3615e None admin] PATH_INFO: `/v3/users/3dbbb9909cec43ff99c1c3682f016ef8` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:34.656221 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb43dbe-3c3f-4de2-913a-42b6eac3615e None admin] RBAC: Authorizing `identity:get_user(user_id=3dbbb9909cec43ff99c1c3682f016ef8)` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:20:34.657669 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb43dbe-3c3f-4de2-913a-42b6eac3615e None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:20:34.659488 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 27/53] 10.222.0.18 () {56 vars in 1177 bytes} [Sat Sep 24 19:20:34 2022] GET /identity/v3/users/3dbbb9909cec43ff99c1c3682f016ef8 => generated 247 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:20:34.666832 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea110eea-1e11-4e9c-9fba-65092fcfde13 None None] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:20:34.737519 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:20:34.768335 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea110eea-1e11-4e9c-9fba-65092fcfde13 None None] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:20:34.802683 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8455d98-8a3b-4ba9-aeef-4906ff2fe750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:20:34.803308 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8455d98-8a3b-4ba9-aeef-4906ff2fe750 None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:34.803595 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8455d98-8a3b-4ba9-aeef-4906ff2fe750 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:34.803886 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8455d98-8a3b-4ba9-aeef-4906ff2fe750 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:34.804970 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8455d98-8a3b-4ba9-aeef-4906ff2fe750 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:20:34.806456 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8455d98-8a3b-4ba9-aeef-4906ff2fe750 None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:20:34.808173 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 27/54] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Sep 24 19:20:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:20:34.813740 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb43dbe-3c3f-4de2-913a-42b6eac3615e None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:20:34.896673 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8455d98-8a3b-4ba9-aeef-4906ff2fe750 None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:20:34.914565 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb43dbe-3c3f-4de2-913a-42b6eac3615e None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:20:34.948045 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9255483d-df9d-4c4f-9854-6e59f1d34bab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:20:34.948644 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9255483d-df9d-4c4f-9854-6e59f1d34bab None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:34.948918 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9255483d-df9d-4c4f-9854-6e59f1d34bab None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:34.949190 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9255483d-df9d-4c4f-9854-6e59f1d34bab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:34.949934 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9255483d-df9d-4c4f-9854-6e59f1d34bab None admin] RBAC: Adding query filter params (role.id=4c7d0dafc19b4b0a9821be6ec0da0a8f, scope.domain.id=default, user.id=3dbbb9909cec43ff99c1c3682f016ef8) {{(pid=88080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:20:34.950240 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9255483d-df9d-4c4f-9854-6e59f1d34bab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:20:34.951697 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9255483d-df9d-4c4f-9854-6e59f1d34bab None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:20:34.957554 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 28/55] 10.222.0.18 () {56 vars in 1322 bytes} [Sat Sep 24 19:20:34 2022] GET /identity/v3/role_assignments?user.id=3dbbb9909cec43ff99c1c3682f016ef8&scope.domain.id=default&role.id=4c7d0dafc19b4b0a9821be6ec0da0a8f => generated 530 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:20:35.003113 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8455d98-8a3b-4ba9-aeef-4906ff2fe750 None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:20:35.039552 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcce63fd-07ea-4bcc-968c-96e2a393e836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:20:35.040212 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcce63fd-07ea-4bcc-968c-96e2a393e836 None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:35.040489 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcce63fd-07ea-4bcc-968c-96e2a393e836 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:35.040755 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcce63fd-07ea-4bcc-968c-96e2a393e836 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:35.041986 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcce63fd-07ea-4bcc-968c-96e2a393e836 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:20:35.043450 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcce63fd-07ea-4bcc-968c-96e2a393e836 None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:20:35.045099 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 28/56] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Sep 24 19:20:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:20:35.050922 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9255483d-df9d-4c4f-9854-6e59f1d34bab None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:20:35.118076 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:20:35.159603 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9255483d-df9d-4c4f-9854-6e59f1d34bab None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:20:35.197163 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1df3bd6-fa97-4163-8359-6f3e9405d9bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:20:35.197785 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1df3bd6-fa97-4163-8359-6f3e9405d9bd None admin] REQUEST_METHOD: `POST` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:35.198089 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1df3bd6-fa97-4163-8359-6f3e9405d9bd None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:35.198357 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1df3bd6-fa97-4163-8359-6f3e9405d9bd None admin] PATH_INFO: `/v3/projects` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:35.199021 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1df3bd6-fa97-4163-8359-6f3e9405d9bd None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:20:35.200452 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1df3bd6-fa97-4163-8359-6f3e9405d9bd None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:20:35.229900 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 29/57] 10.222.0.18 () {60 vars in 1140 bytes} [Sat Sep 24 19:20:35 2022] POST /identity/v3/projects => generated 298 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:20:37.640647 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef4c1ac-4b35-445e-b59e-1e5f226efe1c None None] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:37.641167 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef4c1ac-4b35-445e-b59e-1e5f226efe1c None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:37.641167 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef4c1ac-4b35-445e-b59e-1e5f226efe1c None None] PATH_INFO: `/` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:37.642570 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 29/58] 10.222.0.18 () {54 vars in 927 bytes} [Sat Sep 24 19:20:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:20:37.647729 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc8cca2-50e7-47f8-b183-7c72092461fc None None] REQUEST_METHOD: `POST` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:37.648142 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc8cca2-50e7-47f8-b183-7c72092461fc None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:37.648298 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc8cca2-50e7-47f8-b183-7c72092461fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:37.666619 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.auth.core [None req-5fc8cca2-50e7-47f8-b183-7c72092461fc None None] MFA Rules not processed for user `3dbbb9909cec43ff99c1c3682f016ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=88080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:20:37.667791 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.fernet_utils [None req-5fc8cca2-50e7-47f8-b183-7c72092461fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:20:37.743870 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 30/59] 10.222.0.18 () {58 vars in 1024 bytes} [Sat Sep 24 19:20:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:20:38.061644 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef4c1ac-4b35-445e-b59e-1e5f226efe1c None None] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:20:38.073030 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:20:38.163107 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef4c1ac-4b35-445e-b59e-1e5f226efe1c None None] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:20:38.195316 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7c8213-b6fd-474a-b746-02ef9f63309e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:20:38.195924 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7c8213-b6fd-474a-b746-02ef9f63309e None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:38.196199 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7c8213-b6fd-474a-b746-02ef9f63309e None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:38.196465 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7c8213-b6fd-474a-b746-02ef9f63309e None admin] PATH_INFO: `/v3/domains/default` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:38.197547 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7c8213-b6fd-474a-b746-02ef9f63309e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:20:38.198988 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7c8213-b6fd-474a-b746-02ef9f63309e None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:20:38.200524 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 30/60] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Sep 24 19:20:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:20:38.206211 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc8cca2-50e7-47f8-b183-7c72092461fc None None] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:20:38.250676 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:20:38.304922 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc8cca2-50e7-47f8-b183-7c72092461fc None None] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:20:38.340031 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf48c307-e08f-4c66-895e-28647c2d21b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:20:38.340559 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf48c307-e08f-4c66-895e-28647c2d21b4 None admin] REQUEST_METHOD: `POST` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:38.340821 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf48c307-e08f-4c66-895e-28647c2d21b4 None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:38.341087 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf48c307-e08f-4c66-895e-28647c2d21b4 None admin] PATH_INFO: `/v3/users` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:38.341733 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf48c307-e08f-4c66-895e-28647c2d21b4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:20:38.343187 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf48c307-e08f-4c66-895e-28647c2d21b4 None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:20:38.369985 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 31/61] 10.222.0.18 () {60 vars in 1132 bytes} [Sat Sep 24 19:20:38 2022] POST /identity/v3/users => generated 275 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:20:42.116228 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bacca5-750b-4726-8d00-66078e7ee4e8 None None] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:42.116728 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bacca5-750b-4726-8d00-66078e7ee4e8 None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:42.116800 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bacca5-750b-4726-8d00-66078e7ee4e8 None None] PATH_INFO: `/` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:42.118356 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 31/62] 10.222.0.18 () {54 vars in 927 bytes} [Sat Sep 24 19:20:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:20:42.124090 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3e4f24-0bd7-4c4b-82d2-25e3a46d6ff3 None None] REQUEST_METHOD: `POST` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:42.124558 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3e4f24-0bd7-4c4b-82d2-25e3a46d6ff3 None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:42.124627 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3e4f24-0bd7-4c4b-82d2-25e3a46d6ff3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:42.137572 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0700bc19-de59-4a54-b888-a343772af1b0 None None] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:42.138208 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0700bc19-de59-4a54-b888-a343772af1b0 None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:42.138704 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0700bc19-de59-4a54-b888-a343772af1b0 None None] PATH_INFO: `/` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:42.140504 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 32/63] 10.222.0.18 () {54 vars in 927 bytes} [Sat Sep 24 19:20:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 24 19:20:42.146092 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc21ffbd-eed5-4e52-b02b-733be2cdff79 None None] REQUEST_METHOD: `POST` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:42.146677 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc21ffbd-eed5-4e52-b02b-733be2cdff79 None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:42.147736 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc21ffbd-eed5-4e52-b02b-733be2cdff79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:42.147917 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.auth.core [None req-cb3e4f24-0bd7-4c4b-82d2-25e3a46d6ff3 None None] MFA Rules not processed for user `3dbbb9909cec43ff99c1c3682f016ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=88080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:20:42.149273 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.fernet_utils [None req-cb3e4f24-0bd7-4c4b-82d2-25e3a46d6ff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:20:42.180332 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.auth.core [None req-cc21ffbd-eed5-4e52-b02b-733be2cdff79 None None] MFA Rules not processed for user `3dbbb9909cec43ff99c1c3682f016ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=88081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:20:42.182540 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.fernet_utils [None req-cc21ffbd-eed5-4e52-b02b-733be2cdff79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:20:42.280582 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 32/64] 10.222.0.18 () {58 vars in 1024 bytes} [Sat Sep 24 19:20:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:20:42.311283 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 33/65] 10.222.0.18 () {58 vars in 1024 bytes} [Sat Sep 24 19:20:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:20:42.495019 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3af177c-f171-4766-8579-b1faaec188e7 None None] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:42.495348 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3af177c-f171-4766-8579-b1faaec188e7 None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:42.495516 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3af177c-f171-4766-8579-b1faaec188e7 None None] PATH_INFO: `/` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:42.496816 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 33/66] 10.222.0.18 () {54 vars in 927 bytes} [Sat Sep 24 19:20:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:20:42.502292 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022c616d-24c2-4e84-9d32-2c69b1a4cea4 None None] REQUEST_METHOD: `POST` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:42.502584 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022c616d-24c2-4e84-9d32-2c69b1a4cea4 None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:42.502856 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022c616d-24c2-4e84-9d32-2c69b1a4cea4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:42.518902 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:20:42.530847 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.auth.core [None req-022c616d-24c2-4e84-9d32-2c69b1a4cea4 None None] MFA Rules not processed for user `3dbbb9909cec43ff99c1c3682f016ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=88081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:20:42.532041 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.fernet_utils [None req-022c616d-24c2-4e84-9d32-2c69b1a4cea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:20:42.620363 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 34/67] 10.222.0.18 () {58 vars in 1024 bytes} [Sat Sep 24 19:20:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:20:42.740432 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3af177c-f171-4766-8579-b1faaec188e7 None None] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:20:42.789069 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:20:42.795569 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022c616d-24c2-4e84-9d32-2c69b1a4cea4 None None] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:20:42.908933 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3af177c-f171-4766-8579-b1faaec188e7 None None] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:20:42.919407 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022c616d-24c2-4e84-9d32-2c69b1a4cea4 None None] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:20:42.961075 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e5af46-849c-46ea-bf0b-3fba0ae7cd23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:20:42.961365 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42654fb-a655-4fe2-ae16-966e3c72cb53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:20:42.962210 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e5af46-849c-46ea-bf0b-3fba0ae7cd23 None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:42.962475 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42654fb-a655-4fe2-ae16-966e3c72cb53 None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:42.962561 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e5af46-849c-46ea-bf0b-3fba0ae7cd23 None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:42.962628 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42654fb-a655-4fe2-ae16-966e3c72cb53 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:42.962691 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e5af46-849c-46ea-bf0b-3fba0ae7cd23 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:42.962892 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42654fb-a655-4fe2-ae16-966e3c72cb53 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:42.966366 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:20:42.974727 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e5af46-849c-46ea-bf0b-3fba0ae7cd23 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:20:42.975435 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42654fb-a655-4fe2-ae16-966e3c72cb53 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:20:42.980184 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application [None req-96e5af46-849c-46ea-bf0b-3fba0ae7cd23 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 24 19:20:42.980184 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:20:42.980184 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:20:42.980184 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:20:42.980184 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:20:42.980184 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:20:42.980184 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:20:42.980184 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:20:42.980184 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:20:42.980184 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:20:42.980184 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:20:42.980184 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:20:42.980184 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:20:42.980184 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:20:42.980184 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:20:42.980184 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:20:42.981226 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:20:42.981226 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:20:42.981226 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:20:42.981226 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:20:42.981226 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:20:42.981226 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:20:42.981226 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:20:42.981226 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:20:42.981226 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:20:42.981226 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:20:42.981226 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:20:42.981226 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application with Lock( Sep 24 19:20:42.981226 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:20:42.981226 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:20:42.981226 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:20:42.981226 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:20:42.982948 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:20:42.982948 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:20:42.982948 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:20:42.982948 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:20:42.982948 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:20:42.982948 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:20:42.982948 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:20:42.982948 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:20:42.982948 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:20:42.982948 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:20:42.982948 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 24 19:20:42.982948 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Sep 24 19:20:42.983558 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application [None req-c42654fb-a655-4fe2-ae16-966e3c72cb53 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 19:20:42.983558 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:20:42.983558 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:20:42.983558 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:20:42.983558 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:20:42.983558 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:20:42.983558 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:20:42.983558 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:20:42.983558 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:20:42.983558 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:20:42.983558 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:20:42.983558 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:20:42.983558 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:20:42.983558 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:20:42.983558 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:20:42.983558 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:20:42.984325 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:20:42.984325 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:20:42.984325 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:20:42.984325 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:20:42.984325 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:20:42.984325 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:20:42.984325 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:20:42.984325 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:20:42.984325 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:20:42.984325 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:20:42.984325 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:20:42.984325 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application with Lock( Sep 24 19:20:42.984325 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:20:42.984325 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:20:42.984325 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:20:42.984325 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:20:42.985086 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:20:42.985086 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:20:42.985086 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:20:42.985086 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:20:42.985086 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:20:42.985086 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:20:42.985086 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:20:42.985086 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:20:42.985086 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:20:42.985086 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:20:42.985086 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 19:20:42.985086 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Sep 24 19:20:42.985086 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 35/68] 10.222.0.18 () {56 vars in 1096 bytes} [Sat Sep 24 19:20:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 19:20:42.986572 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 34/69] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Sep 24 19:20:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:20:42.986572 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1571d5a-4831-49a2-9486-92e5692a11e1 None None] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:42.986572 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1571d5a-4831-49a2-9486-92e5692a11e1 None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:42.986572 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1571d5a-4831-49a2-9486-92e5692a11e1 None None] PATH_INFO: `/` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:42.986572 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 35/70] 10.222.0.18 () {54 vars in 927 bytes} [Sat Sep 24 19:20:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:20:42.987301 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36386d5d-e36b-4a42-9051-bea223c22837 None None] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:42.987301 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36386d5d-e36b-4a42-9051-bea223c22837 None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:42.987572 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36386d5d-e36b-4a42-9051-bea223c22837 None None] PATH_INFO: `/` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:42.988831 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1571d5a-4831-49a2-9486-92e5692a11e1 None None] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:20:42.995436 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 36/71] 10.222.0.18 () {54 vars in 927 bytes} [Sat Sep 24 19:20:42 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:20:42.995436 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36386d5d-e36b-4a42-9051-bea223c22837 None None] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:20:43.097821 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:20:43.105374 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36386d5d-e36b-4a42-9051-bea223c22837 None None] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:20:43.109837 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1571d5a-4831-49a2-9486-92e5692a11e1 None None] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:20:43.141163 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b2018e-62c7-45a7-b3ee-290a1f67504e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:20:43.141778 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b2018e-62c7-45a7-b3ee-290a1f67504e None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:43.142092 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b2018e-62c7-45a7-b3ee-290a1f67504e None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:43.142371 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b2018e-62c7-45a7-b3ee-290a1f67504e None admin] PATH_INFO: `/v3/roles` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:43.143043 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b2018e-62c7-45a7-b3ee-290a1f67504e None admin] RBAC: Adding query filter params (name=admin) {{(pid=88081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:20:43.143350 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b2018e-62c7-45a7-b3ee-290a1f67504e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:20:43.144712 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b2018e-62c7-45a7-b3ee-290a1f67504e None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:20:43.145789 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7da4846-880c-4a98-ad14-142294ec1c6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:20:43.146432 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7da4846-880c-4a98-ad14-142294ec1c6e None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:43.146712 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7da4846-880c-4a98-ad14-142294ec1c6e None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:43.147021 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7da4846-880c-4a98-ad14-142294ec1c6e None admin] PATH_INFO: `/v3/roles` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:43.148197 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7da4846-880c-4a98-ad14-142294ec1c6e None admin] RBAC: Adding query filter params (name=member) {{(pid=88080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:20:43.148502 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7da4846-880c-4a98-ad14-142294ec1c6e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:20:43.149914 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7da4846-880c-4a98-ad14-142294ec1c6e None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:20:43.157709 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 37/72] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Sep 24 19:20:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:20:43.158689 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 36/73] 10.222.0.18 () {56 vars in 1101 bytes} [Sat Sep 24 19:20:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:20:43.159706 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7991e2b8-5b08-40ee-bd6f-c3815646d67f None None] REQUEST_METHOD: `POST` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:43.159994 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7991e2b8-5b08-40ee-bd6f-c3815646d67f None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:43.160341 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7991e2b8-5b08-40ee-bd6f-c3815646d67f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:43.162888 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca241e4-586a-46ff-8c8e-f601099187b1 None None] REQUEST_METHOD: `POST` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:43.163310 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca241e4-586a-46ff-8c8e-f601099187b1 None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:43.163486 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca241e4-586a-46ff-8c8e-f601099187b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:43.178739 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.auth.core [None req-7991e2b8-5b08-40ee-bd6f-c3815646d67f None None] MFA Rules not processed for user `3dbbb9909cec43ff99c1c3682f016ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=88080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:20:43.179959 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.fernet_utils [None req-7991e2b8-5b08-40ee-bd6f-c3815646d67f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:20:43.182706 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.auth.core [None req-3ca241e4-586a-46ff-8c8e-f601099187b1 None None] MFA Rules not processed for user `3dbbb9909cec43ff99c1c3682f016ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=88081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:20:43.184077 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.fernet_utils [None req-3ca241e4-586a-46ff-8c8e-f601099187b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:20:43.242246 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:20:43.258761 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 37/74] 10.222.0.18 () {58 vars in 1024 bytes} [Sat Sep 24 19:20:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:20:43.259947 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7991e2b8-5b08-40ee-bd6f-c3815646d67f None None] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:20:43.280471 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 38/75] 10.222.0.18 () {58 vars in 1024 bytes} [Sat Sep 24 19:20:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:20:43.280471 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca241e4-586a-46ff-8c8e-f601099187b1 None None] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:20:43.388312 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:20:43.407920 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7991e2b8-5b08-40ee-bd6f-c3815646d67f None None] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:20:43.442243 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca241e4-586a-46ff-8c8e-f601099187b1 None None] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:20:43.448046 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd329f15-99ad-482e-b29c-6a605dc6af54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:20:43.448691 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd329f15-99ad-482e-b29c-6a605dc6af54 None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:43.448970 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd329f15-99ad-482e-b29c-6a605dc6af54 None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:43.449243 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd329f15-99ad-482e-b29c-6a605dc6af54 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:43.460955 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd329f15-99ad-482e-b29c-6a605dc6af54 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:20:43.465965 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application [None req-dd329f15-99ad-482e-b29c-6a605dc6af54 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 24 19:20:43.465965 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:20:43.465965 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:20:43.465965 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:20:43.465965 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:20:43.465965 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:20:43.465965 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:20:43.465965 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:20:43.465965 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:20:43.465965 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:20:43.465965 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:20:43.465965 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:20:43.465965 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:20:43.465965 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:20:43.465965 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:20:43.465965 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:20:43.466830 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:20:43.466830 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:20:43.466830 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:20:43.466830 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:20:43.466830 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:20:43.466830 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:20:43.466830 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:20:43.466830 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:20:43.466830 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:20:43.466830 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:20:43.466830 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:20:43.466830 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application with Lock( Sep 24 19:20:43.466830 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:20:43.466830 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:20:43.466830 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:20:43.466830 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:20:43.468092 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:20:43.468092 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:20:43.468092 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:20:43.468092 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:20:43.468092 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:20:43.468092 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:20:43.468092 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:20:43.468092 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:20:43.468092 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:20:43.468092 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:20:43.468092 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 24 19:20:43.468092 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Sep 24 19:20:43.468092 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 38/76] 10.222.0.18 () {56 vars in 1114 bytes} [Sat Sep 24 19:20:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:20:43.468092 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd329f15-99ad-482e-b29c-6a605dc6af54 None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:20:43.495054 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e069ad-8976-43ef-b758-51a2272d0ae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:20:43.496733 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e069ad-8976-43ef-b758-51a2272d0ae6 None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:43.497191 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e069ad-8976-43ef-b758-51a2272d0ae6 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:43.497931 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e069ad-8976-43ef-b758-51a2272d0ae6 None admin] PATH_INFO: `/v3/users/3dbbb9909cec43ff99c1c3682f016ef8` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:43.499662 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e069ad-8976-43ef-b758-51a2272d0ae6 None admin] RBAC: Authorizing `identity:get_user(user_id=3dbbb9909cec43ff99c1c3682f016ef8)` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:20:43.501939 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e069ad-8976-43ef-b758-51a2272d0ae6 None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:20:43.504967 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 39/77] 10.222.0.18 () {56 vars in 1177 bytes} [Sat Sep 24 19:20:43 2022] GET /identity/v3/users/3dbbb9909cec43ff99c1c3682f016ef8 => generated 247 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:20:43.506441 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e069ad-8976-43ef-b758-51a2272d0ae6 None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:20:43.577326 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:20:43.596699 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd329f15-99ad-482e-b29c-6a605dc6af54 None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:20:43.624576 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e069ad-8976-43ef-b758-51a2272d0ae6 None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:20:43.633501 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a35c7bf-598b-4242-9a1f-a6af2375ca30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:20:43.634167 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a35c7bf-598b-4242-9a1f-a6af2375ca30 None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:43.634448 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a35c7bf-598b-4242-9a1f-a6af2375ca30 None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:43.634717 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a35c7bf-598b-4242-9a1f-a6af2375ca30 None admin] PATH_INFO: `/v3/users/6fe4c395bf344558954904e47a38c49e` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:43.649049 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a35c7bf-598b-4242-9a1f-a6af2375ca30 None admin] RBAC: Authorizing `identity:get_user(user_id=6fe4c395bf344558954904e47a38c49e)` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:20:43.650478 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a35c7bf-598b-4242-9a1f-a6af2375ca30 None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:20:43.652353 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 39/78] 10.222.0.18 () {56 vars in 1177 bytes} [Sat Sep 24 19:20:43 2022] GET /identity/v3/users/6fe4c395bf344558954904e47a38c49e => generated 275 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:20:43.652900 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a35c7bf-598b-4242-9a1f-a6af2375ca30 None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:20:43.655706 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:20:43.662318 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de439085-c5c5-4fa9-90ca-8b99de8eed36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:20:43.662992 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de439085-c5c5-4fa9-90ca-8b99de8eed36 None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:43.663247 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de439085-c5c5-4fa9-90ca-8b99de8eed36 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:43.663525 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de439085-c5c5-4fa9-90ca-8b99de8eed36 None admin] PATH_INFO: `/v3/roles` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:43.664198 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de439085-c5c5-4fa9-90ca-8b99de8eed36 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:20:43.664502 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de439085-c5c5-4fa9-90ca-8b99de8eed36 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:20:43.665902 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de439085-c5c5-4fa9-90ca-8b99de8eed36 None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:20:43.674415 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 40/79] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Sep 24 19:20:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:20:43.675367 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de439085-c5c5-4fa9-90ca-8b99de8eed36 None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:20:43.761163 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a35c7bf-598b-4242-9a1f-a6af2375ca30 None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:20:43.794700 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de439085-c5c5-4fa9-90ca-8b99de8eed36 None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:20:43.796434 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c6ae36-78b6-4a7f-b55c-b53a9f098d7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:20:43.797036 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c6ae36-78b6-4a7f-b55c-b53a9f098d7a None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:43.797337 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c6ae36-78b6-4a7f-b55c-b53a9f098d7a None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:43.797608 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c6ae36-78b6-4a7f-b55c-b53a9f098d7a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:43.811606 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:20:43.829779 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77091845-34d8-4903-8a40-33832ccf869f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:20:43.830433 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77091845-34d8-4903-8a40-33832ccf869f None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:43.830712 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77091845-34d8-4903-8a40-33832ccf869f None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:43.831010 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77091845-34d8-4903-8a40-33832ccf869f None admin] PATH_INFO: `/v3/roles/member` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:43.842347 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77091845-34d8-4903-8a40-33832ccf869f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:20:43.847581 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application [None req-77091845-34d8-4903-8a40-33832ccf869f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 24 19:20:43.847581 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:20:43.847581 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:20:43.847581 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:20:43.847581 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:20:43.847581 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:20:43.847581 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:20:43.847581 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:20:43.847581 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:20:43.847581 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:20:43.847581 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:20:43.847581 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:20:43.847581 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:20:43.847581 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:20:43.847581 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:20:43.847581 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:20:43.848436 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:20:43.848436 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:20:43.848436 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:20:43.848436 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:20:43.848436 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:20:43.848436 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:20:43.848436 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:20:43.848436 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:20:43.848436 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:20:43.848436 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:20:43.848436 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:20:43.848436 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application with Lock( Sep 24 19:20:43.848436 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:20:43.848436 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:20:43.848436 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:20:43.848436 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:20:43.849389 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:20:43.849389 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:20:43.849389 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:20:43.849389 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:20:43.849389 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:20:43.849389 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:20:43.849389 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:20:43.849389 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:20:43.849389 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:20:43.849389 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:20:43.849389 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 24 19:20:43.849389 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Sep 24 19:20:43.849389 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 41/80] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Sep 24 19:20:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:20:43.850346 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77091845-34d8-4903-8a40-33832ccf869f None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:20:43.871057 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c6ae36-78b6-4a7f-b55c-b53a9f098d7a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:20:43.872514 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c6ae36-78b6-4a7f-b55c-b53a9f098d7a None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:20:43.874349 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:20:43.950038 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77091845-34d8-4903-8a40-33832ccf869f None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:20:43.974509 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 40/81] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Sep 24 19:20:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 24 19:20:43.975396 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c6ae36-78b6-4a7f-b55c-b53a9f098d7a None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:20:43.988218 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17ea07e-99a5-4dfe-8858-0199496d1d7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:20:43.988849 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17ea07e-99a5-4dfe-8858-0199496d1d7c None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:43.989128 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17ea07e-99a5-4dfe-8858-0199496d1d7c None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:43.989400 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17ea07e-99a5-4dfe-8858-0199496d1d7c None admin] PATH_INFO: `/v3/domains/default` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:43.990533 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17ea07e-99a5-4dfe-8858-0199496d1d7c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:20:43.992461 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17ea07e-99a5-4dfe-8858-0199496d1d7c None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:20:43.994318 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 42/82] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Sep 24 19:20:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:20:43.995083 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17ea07e-99a5-4dfe-8858-0199496d1d7c None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:20:44.047783 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:20:44.083030 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c6ae36-78b6-4a7f-b55c-b53a9f098d7a None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:20:44.084627 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:20:44.103681 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17ea07e-99a5-4dfe-8858-0199496d1d7c None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:20:44.120045 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4929fb26-9ed4-4439-a7ec-6091b763e745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:20:44.120651 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4929fb26-9ed4-4439-a7ec-6091b763e745 None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:44.120937 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4929fb26-9ed4-4439-a7ec-6091b763e745 None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:44.121210 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4929fb26-9ed4-4439-a7ec-6091b763e745 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:44.137627 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21da2106-e814-4279-817c-ca2b3baa6198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:20:44.138294 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21da2106-e814-4279-817c-ca2b3baa6198 None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:44.138570 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21da2106-e814-4279-817c-ca2b3baa6198 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:44.138840 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21da2106-e814-4279-817c-ca2b3baa6198 None admin] PATH_INFO: `/v3/users/6fe4c395bf344558954904e47a38c49e` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:44.139974 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21da2106-e814-4279-817c-ca2b3baa6198 None admin] RBAC: Authorizing `identity:get_user(user_id=6fe4c395bf344558954904e47a38c49e)` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:20:44.141389 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21da2106-e814-4279-817c-ca2b3baa6198 None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:20:44.142976 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 43/83] 10.222.0.18 () {56 vars in 1177 bytes} [Sat Sep 24 19:20:43 2022] GET /identity/v3/users/6fe4c395bf344558954904e47a38c49e => generated 275 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:20:44.143743 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21da2106-e814-4279-817c-ca2b3baa6198 None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:20:44.192435 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4929fb26-9ed4-4439-a7ec-6091b763e745 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:20:44.194466 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4929fb26-9ed4-4439-a7ec-6091b763e745 None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:20:44.242560 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21da2106-e814-4279-817c-ca2b3baa6198 None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:20:44.258205 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:20:44.278669 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3b7997-6c28-439f-a6ba-28d3e3162c0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:20:44.279274 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3b7997-6c28-439f-a6ba-28d3e3162c0d None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:44.279553 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3b7997-6c28-439f-a6ba-28d3e3162c0d None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:44.279833 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3b7997-6c28-439f-a6ba-28d3e3162c0d None admin] PATH_INFO: `/v3/roles` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:44.280488 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3b7997-6c28-439f-a6ba-28d3e3162c0d None admin] RBAC: Adding query filter params (name=member) {{(pid=88081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:20:44.280788 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3b7997-6c28-439f-a6ba-28d3e3162c0d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:20:44.282171 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3b7997-6c28-439f-a6ba-28d3e3162c0d None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:20:44.290063 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 44/84] 10.222.0.18 () {56 vars in 1101 bytes} [Sat Sep 24 19:20:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:20:44.291082 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3b7997-6c28-439f-a6ba-28d3e3162c0d None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:20:44.296178 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 41/85] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Sep 24 19:20:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 24 19:20:44.296994 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4929fb26-9ed4-4439-a7ec-6091b763e745 None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:20:44.302576 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:20:44.389570 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3b7997-6c28-439f-a6ba-28d3e3162c0d None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:20:44.401020 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4929fb26-9ed4-4439-a7ec-6091b763e745 None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:20:44.423025 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636ee744-13d1-465d-8e42-183f98e562be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:20:44.423651 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636ee744-13d1-465d-8e42-183f98e562be None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:44.423926 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636ee744-13d1-465d-8e42-183f98e562be None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:44.424198 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636ee744-13d1-465d-8e42-183f98e562be None admin] PATH_INFO: `/v3/projects/b7aa834667ed445eba7561ef6fd2d3c6` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:44.425333 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636ee744-13d1-465d-8e42-183f98e562be None admin] RBAC: Authorizing `identity:get_project(project_id=b7aa834667ed445eba7561ef6fd2d3c6)` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:20:44.426823 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636ee744-13d1-465d-8e42-183f98e562be None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:20:44.428659 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 45/86] 10.222.0.18 () {56 vars in 1186 bytes} [Sat Sep 24 19:20:44 2022] GET /identity/v3/projects/b7aa834667ed445eba7561ef6fd2d3c6 => generated 298 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:20:44.429298 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636ee744-13d1-465d-8e42-183f98e562be None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:20:44.438923 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38863ecb-f03c-4069-9649-c386a5110277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:20:44.439531 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38863ecb-f03c-4069-9649-c386a5110277 None admin] REQUEST_METHOD: `POST` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:44.439813 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38863ecb-f03c-4069-9649-c386a5110277 None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:44.440082 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38863ecb-f03c-4069-9649-c386a5110277 None admin] PATH_INFO: `/v3/users` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:44.440732 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38863ecb-f03c-4069-9649-c386a5110277 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:20:44.442195 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38863ecb-f03c-4069-9649-c386a5110277 None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:20:44.463981 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 42/87] 10.222.0.18 () {60 vars in 1132 bytes} [Sat Sep 24 19:20:44 2022] POST /identity/v3/users => generated 289 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:20:44.464802 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38863ecb-f03c-4069-9649-c386a5110277 None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:20:44.488762 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:20:44.534218 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:20:44.554774 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636ee744-13d1-465d-8e42-183f98e562be None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:20:44.589788 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38863ecb-f03c-4069-9649-c386a5110277 None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:20:44.603699 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ebfa44-1834-4232-a09b-f3337576dd1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:20:44.604340 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ebfa44-1834-4232-a09b-f3337576dd1d None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:44.604623 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ebfa44-1834-4232-a09b-f3337576dd1d None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:44.604895 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ebfa44-1834-4232-a09b-f3337576dd1d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:44.635785 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea3fa01-105a-4013-a1fb-7ab52e750148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:20:44.636953 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea3fa01-105a-4013-a1fb-7ab52e750148 None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:44.637591 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea3fa01-105a-4013-a1fb-7ab52e750148 None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:44.638162 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea3fa01-105a-4013-a1fb-7ab52e750148 None admin] PATH_INFO: `/v3/users/6fe4c395bf344558954904e47a38c49e` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:44.639678 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea3fa01-105a-4013-a1fb-7ab52e750148 None admin] RBAC: Authorizing `identity:get_user(user_id=6fe4c395bf344558954904e47a38c49e)` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:20:44.641697 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea3fa01-105a-4013-a1fb-7ab52e750148 None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:20:44.643880 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 43/88] 10.222.0.18 () {56 vars in 1177 bytes} [Sat Sep 24 19:20:44 2022] GET /identity/v3/users/6fe4c395bf344558954904e47a38c49e => generated 275 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:20:44.645101 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea3fa01-105a-4013-a1fb-7ab52e750148 None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:20:44.689070 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ebfa44-1834-4232-a09b-f3337576dd1d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:20:44.690580 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ebfa44-1834-4232-a09b-f3337576dd1d None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:20:44.747246 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:20:44.767787 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea3fa01-105a-4013-a1fb-7ab52e750148 None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:20:44.801300 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:20:44.814462 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473a2372-3b71-4b29-9c54-8abe69e39081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:20:44.815108 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473a2372-3b71-4b29-9c54-8abe69e39081 None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:44.815383 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473a2372-3b71-4b29-9c54-8abe69e39081 None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:44.815661 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473a2372-3b71-4b29-9c54-8abe69e39081 None admin] PATH_INFO: `/v3/projects/b7aa834667ed445eba7561ef6fd2d3c6` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:44.816820 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473a2372-3b71-4b29-9c54-8abe69e39081 None admin] RBAC: Authorizing `identity:get_project(project_id=b7aa834667ed445eba7561ef6fd2d3c6)` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:20:44.818365 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473a2372-3b71-4b29-9c54-8abe69e39081 None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:20:44.820605 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 44/89] 10.222.0.18 () {56 vars in 1186 bytes} [Sat Sep 24 19:20:44 2022] GET /identity/v3/projects/b7aa834667ed445eba7561ef6fd2d3c6 => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:20:44.821471 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473a2372-3b71-4b29-9c54-8abe69e39081 None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:20:44.829942 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 46/90] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Sep 24 19:20:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 24 19:20:44.830958 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ebfa44-1834-4232-a09b-f3337576dd1d None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:20:44.952403 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473a2372-3b71-4b29-9c54-8abe69e39081 None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:20:44.958919 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ebfa44-1834-4232-a09b-f3337576dd1d None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:20:44.988498 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af0c5df-c59a-4c2a-b58b-c5d146754928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:20:44.989452 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af0c5df-c59a-4c2a-b58b-c5d146754928 None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:44.989993 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af0c5df-c59a-4c2a-b58b-c5d146754928 None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:44.990462 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af0c5df-c59a-4c2a-b58b-c5d146754928 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:44.991920 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af0c5df-c59a-4c2a-b58b-c5d146754928 None admin] RBAC: Adding query filter params (role.id=4c7d0dafc19b4b0a9821be6ec0da0a8f, scope.project.id=b7aa834667ed445eba7561ef6fd2d3c6, user.id=3dbbb9909cec43ff99c1c3682f016ef8) {{(pid=88080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:20:44.992450 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af0c5df-c59a-4c2a-b58b-c5d146754928 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:20:44.994398 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af0c5df-c59a-4c2a-b58b-c5d146754928 None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:20:45.000573 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 45/91] 10.222.0.18 () {56 vars in 1374 bytes} [Sat Sep 24 19:20:44 2022] GET /identity/v3/role_assignments?user.id=3dbbb9909cec43ff99c1c3682f016ef8&scope.project.id=b7aa834667ed445eba7561ef6fd2d3c6&role.id=4c7d0dafc19b4b0a9821be6ec0da0a8f => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:20:45.001372 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bc14ac-5334-4a6c-8e64-59fd5bf06945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:20:45.001980 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af0c5df-c59a-4c2a-b58b-c5d146754928 None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:20:45.002100 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bc14ac-5334-4a6c-8e64-59fd5bf06945 None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:45.002286 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bc14ac-5334-4a6c-8e64-59fd5bf06945 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:45.002565 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bc14ac-5334-4a6c-8e64-59fd5bf06945 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:45.022995 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:20:45.097948 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:20:45.098119 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bc14ac-5334-4a6c-8e64-59fd5bf06945 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:20:45.098599 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bc14ac-5334-4a6c-8e64-59fd5bf06945 None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:20:45.185819 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af0c5df-c59a-4c2a-b58b-c5d146754928 None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:20:45.226791 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 47/92] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Sep 24 19:20:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 24 19:20:45.227582 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bc14ac-5334-4a6c-8e64-59fd5bf06945 None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:20:45.258523 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331d4582-1853-42e4-8bd3-af4dc9ca5cf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:20:45.259182 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331d4582-1853-42e4-8bd3-af4dc9ca5cf1 None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:45.259420 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331d4582-1853-42e4-8bd3-af4dc9ca5cf1 None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:45.259694 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331d4582-1853-42e4-8bd3-af4dc9ca5cf1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:45.260421 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331d4582-1853-42e4-8bd3-af4dc9ca5cf1 None admin] RBAC: Adding query filter params (role.id=3a42524fc57c4487a34c5c05234413a7, scope.project.id=b7aa834667ed445eba7561ef6fd2d3c6, user.id=6fe4c395bf344558954904e47a38c49e) {{(pid=88080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:20:45.260733 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331d4582-1853-42e4-8bd3-af4dc9ca5cf1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:20:45.262227 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331d4582-1853-42e4-8bd3-af4dc9ca5cf1 None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:20:45.269115 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 46/93] 10.222.0.18 () {56 vars in 1374 bytes} [Sat Sep 24 19:20:45 2022] GET /identity/v3/role_assignments?user.id=6fe4c395bf344558954904e47a38c49e&scope.project.id=b7aa834667ed445eba7561ef6fd2d3c6&role.id=3a42524fc57c4487a34c5c05234413a7 => generated 259 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:20:45.274141 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331d4582-1853-42e4-8bd3-af4dc9ca5cf1 None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:20:45.292230 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:20:45.347209 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bc14ac-5334-4a6c-8e64-59fd5bf06945 None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:20:45.386049 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c3bf03-6000-4c65-bc52-4559da5a196e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:20:45.386702 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c3bf03-6000-4c65-bc52-4559da5a196e None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:45.387115 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c3bf03-6000-4c65-bc52-4559da5a196e None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:45.387395 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c3bf03-6000-4c65-bc52-4559da5a196e None admin] PATH_INFO: `/v3/projects/b7aa834667ed445eba7561ef6fd2d3c6` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:45.388568 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c3bf03-6000-4c65-bc52-4559da5a196e None admin] RBAC: Authorizing `identity:get_project(project_id=b7aa834667ed445eba7561ef6fd2d3c6)` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:20:45.390035 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c3bf03-6000-4c65-bc52-4559da5a196e None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:20:45.392046 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 48/94] 10.222.0.18 () {56 vars in 1186 bytes} [Sat Sep 24 19:20:45 2022] GET /identity/v3/projects/b7aa834667ed445eba7561ef6fd2d3c6 => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:20:45.411275 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c3bf03-6000-4c65-bc52-4559da5a196e None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:20:45.577264 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331d4582-1853-42e4-8bd3-af4dc9ca5cf1 None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:20:45.579539 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c3bf03-6000-4c65-bc52-4559da5a196e None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:20:45.608491 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:20:45.632514 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:20:45.643862 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f12f384-cf72-4252-a092-657f2b761ae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:20:45.644407 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f12f384-cf72-4252-a092-657f2b761ae6 None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:45.644687 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f12f384-cf72-4252-a092-657f2b761ae6 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:45.644959 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f12f384-cf72-4252-a092-657f2b761ae6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:45.645691 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f12f384-cf72-4252-a092-657f2b761ae6 None admin] RBAC: Adding query filter params (role.id=a24280fb630f4c17865458d833144b17, scope.project.id=b7aa834667ed445eba7561ef6fd2d3c6, user.id=6fe4c395bf344558954904e47a38c49e) {{(pid=88081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:20:45.651971 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f12f384-cf72-4252-a092-657f2b761ae6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:20:45.653619 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f12f384-cf72-4252-a092-657f2b761ae6 None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:20:45.659348 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48917c0-3a4b-43df-8a17-fc04140e7e8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:20:45.660119 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48917c0-3a4b-43df-8a17-fc04140e7e8c None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:45.660402 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48917c0-3a4b-43df-8a17-fc04140e7e8c None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:45.660672 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48917c0-3a4b-43df-8a17-fc04140e7e8c None admin] PATH_INFO: `/v3/projects/a7b33840413d4f388f2510aecd344eec` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:45.667586 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48917c0-3a4b-43df-8a17-fc04140e7e8c None admin] RBAC: Authorizing `identity:get_project(project_id=a7b33840413d4f388f2510aecd344eec)` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:20:45.669079 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48917c0-3a4b-43df-8a17-fc04140e7e8c None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:20:45.669852 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 49/95] 10.222.0.18 () {56 vars in 1374 bytes} [Sat Sep 24 19:20:45 2022] GET /identity/v3/role_assignments?user.id=6fe4c395bf344558954904e47a38c49e&scope.project.id=b7aa834667ed445eba7561ef6fd2d3c6&role.id=a24280fb630f4c17865458d833144b17 => generated 259 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:20:45.672682 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 47/96] 10.222.0.18 () {56 vars in 1186 bytes} [Sat Sep 24 19:20:45 2022] GET /identity/v3/projects/a7b33840413d4f388f2510aecd344eec => generated 312 bytes in 403 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:20:45.679600 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f12f384-cf72-4252-a092-657f2b761ae6 None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:20:45.811396 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f12f384-cf72-4252-a092-657f2b761ae6 None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:20:45.847279 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53496b2-941a-4cd3-b303-c60c44ec9b3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:20:45.848321 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53496b2-941a-4cd3-b303-c60c44ec9b3d None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:45.848799 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53496b2-941a-4cd3-b303-c60c44ec9b3d None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:45.849266 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53496b2-941a-4cd3-b303-c60c44ec9b3d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:45.850391 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53496b2-941a-4cd3-b303-c60c44ec9b3d None admin] RBAC: Adding query filter params (role.id=3a42524fc57c4487a34c5c05234413a7, scope.project.id=a7b33840413d4f388f2510aecd344eec, user.id=6fe4c395bf344558954904e47a38c49e) {{(pid=88081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:20:45.850959 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53496b2-941a-4cd3-b303-c60c44ec9b3d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:20:45.852663 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53496b2-941a-4cd3-b303-c60c44ec9b3d None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:20:45.859331 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 50/97] 10.222.0.18 () {56 vars in 1374 bytes} [Sat Sep 24 19:20:45 2022] GET /identity/v3/role_assignments?user.id=6fe4c395bf344558954904e47a38c49e&scope.project.id=a7b33840413d4f388f2510aecd344eec&role.id=3a42524fc57c4487a34c5c05234413a7 => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:20:47.726274 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dbb18c-9ce7-4f80-99a5-b8e24aae9f56 None None] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:47.726788 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dbb18c-9ce7-4f80-99a5-b8e24aae9f56 None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:47.726788 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dbb18c-9ce7-4f80-99a5-b8e24aae9f56 None None] PATH_INFO: `/` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:47.728499 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 48/98] 10.222.0.18 () {54 vars in 927 bytes} [Sat Sep 24 19:20:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:20:47.733739 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ae1ccb-67d1-498d-bdb3-63ab551c6dea None None] REQUEST_METHOD: `POST` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:47.734189 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ae1ccb-67d1-498d-bdb3-63ab551c6dea None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:47.734364 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ae1ccb-67d1-498d-bdb3-63ab551c6dea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:47.759050 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.auth.core [None req-e7ae1ccb-67d1-498d-bdb3-63ab551c6dea None None] MFA Rules not processed for user `3dbbb9909cec43ff99c1c3682f016ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=88081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:20:47.760171 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.fernet_utils [None req-e7ae1ccb-67d1-498d-bdb3-63ab551c6dea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:20:47.801599 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:20:47.847248 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 51/99] 10.222.0.18 () {58 vars in 1024 bytes} [Sat Sep 24 19:20:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:20:48.353886 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4537e1-92fe-494d-b385-e0bdbd197c5c None None] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:48.354292 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4537e1-92fe-494d-b385-e0bdbd197c5c None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:48.354464 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4537e1-92fe-494d-b385-e0bdbd197c5c None None] PATH_INFO: `/` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:48.356130 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 49/100] 10.222.0.18 () {54 vars in 927 bytes} [Sat Sep 24 19:20:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:20:48.367805 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b481bd-bbfc-426d-b1f2-492865dddd9e None None] REQUEST_METHOD: `POST` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:48.368102 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b481bd-bbfc-426d-b1f2-492865dddd9e None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:48.368361 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b481bd-bbfc-426d-b1f2-492865dddd9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:48.393125 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.auth.core [None req-94b481bd-bbfc-426d-b1f2-492865dddd9e None None] MFA Rules not processed for user `3dbbb9909cec43ff99c1c3682f016ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=88081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:20:48.394646 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.fernet_utils [None req-94b481bd-bbfc-426d-b1f2-492865dddd9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:20:48.439300 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4537e1-92fe-494d-b385-e0bdbd197c5c None None] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:20:48.496897 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 52/101] 10.222.0.18 () {58 vars in 1024 bytes} [Sat Sep 24 19:20:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:20:48.590667 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4537e1-92fe-494d-b385-e0bdbd197c5c None None] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:20:48.627959 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74fcf43-d29f-42e5-aa26-e76493c06afd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:20:48.628506 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74fcf43-d29f-42e5-aa26-e76493c06afd None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:48.628781 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74fcf43-d29f-42e5-aa26-e76493c06afd None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:48.629049 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74fcf43-d29f-42e5-aa26-e76493c06afd None admin] PATH_INFO: `/v3/domains/default` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:48.630186 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74fcf43-d29f-42e5-aa26-e76493c06afd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:20:48.632362 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74fcf43-d29f-42e5-aa26-e76493c06afd None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:20:48.634303 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 50/102] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Sep 24 19:20:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:20:48.640136 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b481bd-bbfc-426d-b1f2-492865dddd9e None None] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:20:48.799907 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:20:48.801176 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced0bc49-6f5a-4024-a2b4-5b08664c543f None None] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:48.802120 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced0bc49-6f5a-4024-a2b4-5b08664c543f None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:48.803385 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced0bc49-6f5a-4024-a2b4-5b08664c543f None None] PATH_INFO: `/` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:48.803943 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b481bd-bbfc-426d-b1f2-492865dddd9e None None] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:20:48.809970 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 51/103] 10.222.0.18 () {54 vars in 927 bytes} [Sat Sep 24 19:20:48 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 24 19:20:48.812538 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13ecd22-a270-4efd-a6c3-bd9ea2f3d11e None None] REQUEST_METHOD: `POST` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:48.813030 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13ecd22-a270-4efd-a6c3-bd9ea2f3d11e None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:48.813495 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13ecd22-a270-4efd-a6c3-bd9ea2f3d11e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:48.841596 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.auth.core [None req-e13ecd22-a270-4efd-a6c3-bd9ea2f3d11e None None] MFA Rules not processed for user `3dbbb9909cec43ff99c1c3682f016ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=88080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:20:48.842835 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.fernet_utils [None req-e13ecd22-a270-4efd-a6c3-bd9ea2f3d11e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:20:48.876574 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e39386-f502-462e-a21d-25f9e4b2c3cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:20:48.877215 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e39386-f502-462e-a21d-25f9e4b2c3cb None admin] REQUEST_METHOD: `POST` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:48.877498 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e39386-f502-462e-a21d-25f9e4b2c3cb None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:48.877771 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e39386-f502-462e-a21d-25f9e4b2c3cb None admin] PATH_INFO: `/v3/projects` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:48.878530 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e39386-f502-462e-a21d-25f9e4b2c3cb None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:20:48.879985 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e39386-f502-462e-a21d-25f9e4b2c3cb None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:20:48.928867 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 53/104] 10.222.0.18 () {60 vars in 1141 bytes} [Sat Sep 24 19:20:48 2022] POST /identity/v3/projects => generated 302 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:20:48.950835 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:20:48.980500 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 52/105] 10.222.0.18 () {58 vars in 1024 bytes} [Sat Sep 24 19:20:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 24 19:20:49.113980 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66930db3-08d3-4762-abbc-2ddfc0eb1f5f None None] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:49.114304 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66930db3-08d3-4762-abbc-2ddfc0eb1f5f None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:49.114629 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66930db3-08d3-4762-abbc-2ddfc0eb1f5f None None] PATH_INFO: `/` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:49.116082 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 54/106] 10.222.0.18 () {54 vars in 927 bytes} [Sat Sep 24 19:20:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:20:49.132594 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5be47a-280e-4c69-99f4-f715f49bd2e7 None None] REQUEST_METHOD: `POST` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:49.132771 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5be47a-280e-4c69-99f4-f715f49bd2e7 None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:49.133154 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5be47a-280e-4c69-99f4-f715f49bd2e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:49.155188 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.auth.core [None req-2a5be47a-280e-4c69-99f4-f715f49bd2e7 None None] MFA Rules not processed for user `3dbbb9909cec43ff99c1c3682f016ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=88080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:20:49.156377 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.fernet_utils [None req-2a5be47a-280e-4c69-99f4-f715f49bd2e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:20:49.178656 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66930db3-08d3-4762-abbc-2ddfc0eb1f5f None None] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:20:49.246445 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 53/107] 10.222.0.18 () {58 vars in 1024 bytes} [Sat Sep 24 19:20:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:20:49.331880 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66930db3-08d3-4762-abbc-2ddfc0eb1f5f None None] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:20:49.375025 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1578e3-a485-46b8-b6c0-1386dcbf2225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:20:49.375742 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1578e3-a485-46b8-b6c0-1386dcbf2225 None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:49.376035 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1578e3-a485-46b8-b6c0-1386dcbf2225 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:49.376313 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1578e3-a485-46b8-b6c0-1386dcbf2225 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:49.390880 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1578e3-a485-46b8-b6c0-1386dcbf2225 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:20:49.396066 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application [None req-4f1578e3-a485-46b8-b6c0-1386dcbf2225 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 24 19:20:49.396066 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:20:49.396066 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:20:49.396066 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:20:49.396066 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:20:49.396066 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:20:49.396066 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:20:49.396066 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:20:49.396066 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:20:49.396066 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:20:49.396066 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:20:49.396066 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:20:49.396066 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:20:49.396066 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:20:49.396066 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:20:49.396066 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:20:49.397482 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:20:49.397482 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:20:49.397482 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:20:49.397482 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:20:49.397482 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:20:49.397482 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:20:49.397482 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:20:49.397482 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:20:49.397482 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:20:49.397482 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:20:49.397482 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:20:49.397482 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application with Lock( Sep 24 19:20:49.397482 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:20:49.397482 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:20:49.397482 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:20:49.397482 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:20:49.398422 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:20:49.398422 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:20:49.398422 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:20:49.398422 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:20:49.398422 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:20:49.398422 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:20:49.398422 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:20:49.398422 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:20:49.398422 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:20:49.398422 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:20:49.398422 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 24 19:20:49.398422 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Sep 24 19:20:49.398422 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 55/108] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Sep 24 19:20:49 2022] GET /identity/v3/roles/reader => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:20:49.403844 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5be47a-280e-4c69-99f4-f715f49bd2e7 None None] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:20:49.517190 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d6ccff-38b3-4114-bda6-bfb34203673c None None] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:49.517526 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d6ccff-38b3-4114-bda6-bfb34203673c None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:49.517788 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d6ccff-38b3-4114-bda6-bfb34203673c None None] PATH_INFO: `/` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:49.518304 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5be47a-280e-4c69-99f4-f715f49bd2e7 None None] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:20:49.519475 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 56/109] 10.222.0.18 () {54 vars in 927 bytes} [Sat Sep 24 19:20:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:20:49.525553 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52ecb68-adad-47c9-8dfb-5ee6a99db70a None None] REQUEST_METHOD: `POST` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:49.525850 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52ecb68-adad-47c9-8dfb-5ee6a99db70a None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:49.526167 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52ecb68-adad-47c9-8dfb-5ee6a99db70a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:49.541815 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:20:49.549373 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.auth.core [None req-f52ecb68-adad-47c9-8dfb-5ee6a99db70a None None] MFA Rules not processed for user `3dbbb9909cec43ff99c1c3682f016ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=88081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:20:49.550891 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.fernet_utils [None req-f52ecb68-adad-47c9-8dfb-5ee6a99db70a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:20:49.560617 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:20:49.569305 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00aa8549-83d0-4843-9f1c-ded79560ad12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:20:49.569912 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aa8549-83d0-4843-9f1c-ded79560ad12 None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:49.570200 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aa8549-83d0-4843-9f1c-ded79560ad12 None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:49.570475 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aa8549-83d0-4843-9f1c-ded79560ad12 None admin] PATH_INFO: `/v3/roles` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:49.571155 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00aa8549-83d0-4843-9f1c-ded79560ad12 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:20:49.571461 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00aa8549-83d0-4843-9f1c-ded79560ad12 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:20:49.572864 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00aa8549-83d0-4843-9f1c-ded79560ad12 None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:20:49.586676 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 54/110] 10.222.0.18 () {56 vars in 1101 bytes} [Sat Sep 24 19:20:49 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:20:49.592255 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00aa8549-83d0-4843-9f1c-ded79560ad12 None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:20:49.664205 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 57/111] 10.222.0.18 () {58 vars in 1024 bytes} [Sat Sep 24 19:20:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 24 19:20:49.665450 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52ecb68-adad-47c9-8dfb-5ee6a99db70a None None] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:20:49.701975 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00aa8549-83d0-4843-9f1c-ded79560ad12 None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:20:49.733200 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789251e8-09fc-4a78-ae6b-4f4179d40e4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:20:49.733857 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789251e8-09fc-4a78-ae6b-4f4179d40e4d None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:49.734149 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789251e8-09fc-4a78-ae6b-4f4179d40e4d None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:49.734424 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789251e8-09fc-4a78-ae6b-4f4179d40e4d None admin] PATH_INFO: `/v3/users/d5e4d93077134f6193a6cf0d9b2cc1f8` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:49.749122 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789251e8-09fc-4a78-ae6b-4f4179d40e4d None admin] RBAC: Authorizing `identity:get_user(user_id=d5e4d93077134f6193a6cf0d9b2cc1f8)` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:20:49.750637 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789251e8-09fc-4a78-ae6b-4f4179d40e4d None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:20:49.752326 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 55/112] 10.222.0.18 () {56 vars in 1177 bytes} [Sat Sep 24 19:20:49 2022] GET /identity/v3/users/d5e4d93077134f6193a6cf0d9b2cc1f8 => generated 289 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:20:49.763131 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789251e8-09fc-4a78-ae6b-4f4179d40e4d None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:20:49.812604 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:20:49.878395 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789251e8-09fc-4a78-ae6b-4f4179d40e4d None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:20:49.883306 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52ecb68-adad-47c9-8dfb-5ee6a99db70a None None] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:20:49.915498 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa2683b-1f47-49a4-a7a6-3b4f4417a177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:20:49.916043 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa2683b-1f47-49a4-a7a6-3b4f4417a177 None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:49.916327 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa2683b-1f47-49a4-a7a6-3b4f4417a177 None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:49.916609 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa2683b-1f47-49a4-a7a6-3b4f4417a177 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:49.946234 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673b812d-8bfb-4ae5-8b3b-4688dc3dfcd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:20:49.946886 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673b812d-8bfb-4ae5-8b3b-4688dc3dfcd6 None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:49.947167 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673b812d-8bfb-4ae5-8b3b-4688dc3dfcd6 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:49.947436 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673b812d-8bfb-4ae5-8b3b-4688dc3dfcd6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:49.958454 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673b812d-8bfb-4ae5-8b3b-4688dc3dfcd6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:20:49.963941 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application [None req-673b812d-8bfb-4ae5-8b3b-4688dc3dfcd6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 19:20:49.963941 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:20:49.963941 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:20:49.963941 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:20:49.963941 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:20:49.963941 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:20:49.963941 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:20:49.963941 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:20:49.963941 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:20:49.963941 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:20:49.963941 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:20:49.963941 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:20:49.963941 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:20:49.963941 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:20:49.963941 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:20:49.963941 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:20:49.964895 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:20:49.964895 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:20:49.964895 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:20:49.964895 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:20:49.964895 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:20:49.964895 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:20:49.964895 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:20:49.964895 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:20:49.964895 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:20:49.964895 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:20:49.964895 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:20:49.964895 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application with Lock( Sep 24 19:20:49.964895 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:20:49.964895 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:20:49.964895 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:20:49.964895 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:20:49.965634 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:20:49.965634 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:20:49.965634 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:20:49.965634 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:20:49.965634 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:20:49.965634 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:20:49.965634 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:20:49.965634 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:20:49.965634 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:20:49.965634 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:20:49.965634 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 19:20:49.965634 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Sep 24 19:20:49.965634 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 58/113] 10.222.0.18 () {56 vars in 1096 bytes} [Sat Sep 24 19:20:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:20:49.966301 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673b812d-8bfb-4ae5-8b3b-4688dc3dfcd6 None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:20:49.969734 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:20:50.006069 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa2683b-1f47-49a4-a7a6-3b4f4417a177 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:20:50.008674 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa2683b-1f47-49a4-a7a6-3b4f4417a177 None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:20:50.057723 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:20:50.096671 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673b812d-8bfb-4ae5-8b3b-4688dc3dfcd6 None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:20:50.141758 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 56/114] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Sep 24 19:20:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 24 19:20:50.143441 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02406a39-f38c-491d-b453-a4644965182a None None] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:50.143729 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02406a39-f38c-491d-b453-a4644965182a None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:50.144003 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02406a39-f38c-491d-b453-a4644965182a None None] PATH_INFO: `/` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:50.149613 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 57/115] 10.222.0.18 () {54 vars in 927 bytes} [Sat Sep 24 19:20:50 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:20:50.150505 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02406a39-f38c-491d-b453-a4644965182a None None] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:20:50.151882 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced05a18-1eb5-43b0-a65b-7451a3060125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:20:50.152871 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced05a18-1eb5-43b0-a65b-7451a3060125 None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:50.153378 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced05a18-1eb5-43b0-a65b-7451a3060125 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:50.153913 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced05a18-1eb5-43b0-a65b-7451a3060125 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:50.170427 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced05a18-1eb5-43b0-a65b-7451a3060125 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:20:50.176576 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application [None req-ced05a18-1eb5-43b0-a65b-7451a3060125 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 24 19:20:50.176576 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:20:50.176576 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:20:50.176576 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:20:50.176576 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:20:50.176576 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:20:50.176576 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:20:50.176576 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:20:50.176576 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:20:50.176576 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:20:50.176576 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:20:50.176576 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:20:50.176576 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:20:50.176576 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:20:50.176576 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:20:50.176576 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:20:50.177447 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:20:50.177447 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:20:50.177447 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:20:50.177447 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:20:50.177447 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:20:50.177447 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:20:50.177447 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:20:50.177447 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:20:50.177447 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:20:50.177447 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:20:50.177447 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:20:50.177447 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application with Lock( Sep 24 19:20:50.177447 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:20:50.177447 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:20:50.177447 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:20:50.177447 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:20:50.178765 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:20:50.178765 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:20:50.178765 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:20:50.178765 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:20:50.178765 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:20:50.178765 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:20:50.178765 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:20:50.178765 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:20:50.178765 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:20:50.178765 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:20:50.178765 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 24 19:20:50.178765 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Sep 24 19:20:50.180273 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 59/116] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Sep 24 19:20:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:20:50.181121 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced05a18-1eb5-43b0-a65b-7451a3060125 None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:20:50.253900 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:20:50.277311 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02406a39-f38c-491d-b453-a4644965182a None None] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:20:50.299406 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced05a18-1eb5-43b0-a65b-7451a3060125 None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:20:50.315788 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf7d0fe-7d0d-42d5-aac0-f771b3a37c96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:20:50.316396 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf7d0fe-7d0d-42d5-aac0-f771b3a37c96 None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:50.316669 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf7d0fe-7d0d-42d5-aac0-f771b3a37c96 None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:50.316943 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf7d0fe-7d0d-42d5-aac0-f771b3a37c96 None admin] PATH_INFO: `/v3/roles` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:50.317601 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf7d0fe-7d0d-42d5-aac0-f771b3a37c96 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:20:50.317937 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf7d0fe-7d0d-42d5-aac0-f771b3a37c96 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:20:50.319916 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf7d0fe-7d0d-42d5-aac0-f771b3a37c96 None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:20:50.325757 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:20:50.335714 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 58/117] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Sep 24 19:20:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:20:50.336732 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf7d0fe-7d0d-42d5-aac0-f771b3a37c96 None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:20:50.342671 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd29310-4ec2-42ca-ae4d-3d4f727e0663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:20:50.343527 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd29310-4ec2-42ca-ae4d-3d4f727e0663 None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:50.343975 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd29310-4ec2-42ca-ae4d-3d4f727e0663 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:50.344398 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd29310-4ec2-42ca-ae4d-3d4f727e0663 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:50.358098 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd29310-4ec2-42ca-ae4d-3d4f727e0663 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:20:50.363826 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application [None req-ccd29310-4ec2-42ca-ae4d-3d4f727e0663 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 24 19:20:50.363826 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:20:50.363826 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:20:50.363826 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:20:50.363826 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:20:50.363826 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:20:50.363826 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:20:50.363826 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:20:50.363826 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:20:50.363826 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:20:50.363826 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:20:50.363826 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:20:50.363826 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:20:50.363826 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:20:50.363826 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:20:50.363826 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:20:50.365123 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:20:50.365123 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:20:50.365123 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:20:50.365123 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:20:50.365123 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:20:50.365123 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:20:50.365123 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:20:50.365123 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:20:50.365123 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:20:50.365123 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:20:50.365123 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:20:50.365123 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application with Lock( Sep 24 19:20:50.365123 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:20:50.365123 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:20:50.365123 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:20:50.365123 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:20:50.366975 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:20:50.366975 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:20:50.366975 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:20:50.366975 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:20:50.366975 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:20:50.366975 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:20:50.366975 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:20:50.366975 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:20:50.366975 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:20:50.366975 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:20:50.366975 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 24 19:20:50.366975 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Sep 24 19:20:50.370746 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 60/118] 10.222.0.18 () {56 vars in 1114 bytes} [Sat Sep 24 19:20:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:20:50.372035 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610d7193-d361-48d9-97e7-6b2de49a26bb None None] REQUEST_METHOD: `POST` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:50.372322 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610d7193-d361-48d9-97e7-6b2de49a26bb None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:50.372629 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610d7193-d361-48d9-97e7-6b2de49a26bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:50.391583 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.auth.core [None req-610d7193-d361-48d9-97e7-6b2de49a26bb None None] MFA Rules not processed for user `3dbbb9909cec43ff99c1c3682f016ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=88081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:20:50.393003 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.fernet_utils [None req-610d7193-d361-48d9-97e7-6b2de49a26bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:20:50.465351 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf7d0fe-7d0d-42d5-aac0-f771b3a37c96 None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:20:50.477861 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 61/119] 10.222.0.18 () {58 vars in 1024 bytes} [Sat Sep 24 19:20:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:20:50.477861 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610d7193-d361-48d9-97e7-6b2de49a26bb None None] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:20:50.506720 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d131994-1500-48fa-95dc-6ec9080d56b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:20:50.507592 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d131994-1500-48fa-95dc-6ec9080d56b4 None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:50.508059 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d131994-1500-48fa-95dc-6ec9080d56b4 None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:50.508436 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d131994-1500-48fa-95dc-6ec9080d56b4 None admin] PATH_INFO: `/v3/projects/b7aa834667ed445eba7561ef6fd2d3c6` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:50.509696 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d131994-1500-48fa-95dc-6ec9080d56b4 None admin] RBAC: Authorizing `identity:get_project(project_id=b7aa834667ed445eba7561ef6fd2d3c6)` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:20:50.511496 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d131994-1500-48fa-95dc-6ec9080d56b4 None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:20:50.513215 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 59/120] 10.222.0.18 () {56 vars in 1186 bytes} [Sat Sep 24 19:20:50 2022] GET /identity/v3/projects/b7aa834667ed445eba7561ef6fd2d3c6 => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:20:50.514166 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d131994-1500-48fa-95dc-6ec9080d56b4 None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:20:50.548238 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:20:50.591597 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:20:50.642359 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610d7193-d361-48d9-97e7-6b2de49a26bb None None] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:20:50.644270 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d131994-1500-48fa-95dc-6ec9080d56b4 None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:20:50.686122 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f622eec2-3015-4de2-a3c2-c2b42d57fb85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:20:50.686754 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f622eec2-3015-4de2-a3c2-c2b42d57fb85 None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:50.687039 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f622eec2-3015-4de2-a3c2-c2b42d57fb85 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:50.687311 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f622eec2-3015-4de2-a3c2-c2b42d57fb85 None admin] PATH_INFO: `/v3/roles` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:50.688010 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f622eec2-3015-4de2-a3c2-c2b42d57fb85 None admin] RBAC: Adding query filter params (name=member) {{(pid=88081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:20:50.688297 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f622eec2-3015-4de2-a3c2-c2b42d57fb85 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:20:50.689868 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f622eec2-3015-4de2-a3c2-c2b42d57fb85 None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:20:50.693122 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979559c1-278e-4607-92c7-01e92a766b1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:20:50.694647 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979559c1-278e-4607-92c7-01e92a766b1e None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:50.695131 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979559c1-278e-4607-92c7-01e92a766b1e None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:50.695627 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979559c1-278e-4607-92c7-01e92a766b1e None admin] PATH_INFO: `/v3/users/3dbbb9909cec43ff99c1c3682f016ef8` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:50.697215 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979559c1-278e-4607-92c7-01e92a766b1e None admin] RBAC: Authorizing `identity:get_user(user_id=3dbbb9909cec43ff99c1c3682f016ef8)` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:20:50.698960 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979559c1-278e-4607-92c7-01e92a766b1e None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:20:50.704803 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 62/121] 10.222.0.18 () {56 vars in 1101 bytes} [Sat Sep 24 19:20:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:20:50.704803 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f622eec2-3015-4de2-a3c2-c2b42d57fb85 None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:20:50.706473 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 60/122] 10.222.0.18 () {56 vars in 1177 bytes} [Sat Sep 24 19:20:50 2022] GET /identity/v3/users/3dbbb9909cec43ff99c1c3682f016ef8 => generated 247 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:20:50.707602 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979559c1-278e-4607-92c7-01e92a766b1e None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:20:50.820990 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f622eec2-3015-4de2-a3c2-c2b42d57fb85 None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:20:50.830314 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979559c1-278e-4607-92c7-01e92a766b1e None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:20:50.837513 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:20:50.858834 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638d896b-58d1-4937-8b46-b2fe0d4ba756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:20:50.859621 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638d896b-58d1-4937-8b46-b2fe0d4ba756 None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:50.860293 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638d896b-58d1-4937-8b46-b2fe0d4ba756 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:50.860558 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638d896b-58d1-4937-8b46-b2fe0d4ba756 None admin] PATH_INFO: `/v3/roles` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:50.861333 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638d896b-58d1-4937-8b46-b2fe0d4ba756 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:20:50.861637 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638d896b-58d1-4937-8b46-b2fe0d4ba756 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:20:50.863047 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638d896b-58d1-4937-8b46-b2fe0d4ba756 None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:20:50.871336 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4d366a-0818-47eb-95c0-5acbdbc47258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:20:50.871948 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4d366a-0818-47eb-95c0-5acbdbc47258 None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:50.872233 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4d366a-0818-47eb-95c0-5acbdbc47258 None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:50.872509 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4d366a-0818-47eb-95c0-5acbdbc47258 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:50.877310 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 63/123] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Sep 24 19:20:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:20:50.877461 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4d366a-0818-47eb-95c0-5acbdbc47258 None admin] RBAC: Adding query filter params (role.id=f072ea6ff7ca4dbf90174c318d19acf1, scope.project.id=b7aa834667ed445eba7561ef6fd2d3c6, user.id=d5e4d93077134f6193a6cf0d9b2cc1f8) {{(pid=88080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:20:50.877461 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4d366a-0818-47eb-95c0-5acbdbc47258 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:20:50.877651 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638d896b-58d1-4937-8b46-b2fe0d4ba756 None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:20:50.877762 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4d366a-0818-47eb-95c0-5acbdbc47258 None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:20:50.879868 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:20:50.894200 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 61/124] 10.222.0.18 () {56 vars in 1374 bytes} [Sat Sep 24 19:20:50 2022] GET /identity/v3/role_assignments?user.id=d5e4d93077134f6193a6cf0d9b2cc1f8&scope.project.id=b7aa834667ed445eba7561ef6fd2d3c6&role.id=f072ea6ff7ca4dbf90174c318d19acf1 => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:20:50.895109 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4d366a-0818-47eb-95c0-5acbdbc47258 None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:20:51.006643 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638d896b-58d1-4937-8b46-b2fe0d4ba756 None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:20:51.024216 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4d366a-0818-47eb-95c0-5acbdbc47258 None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:20:51.055653 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e62c3ea-84e1-437c-b559-46332944e27d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:20:51.056307 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e62c3ea-84e1-437c-b559-46332944e27d None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:51.056586 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e62c3ea-84e1-437c-b559-46332944e27d None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:51.056859 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e62c3ea-84e1-437c-b559-46332944e27d None admin] PATH_INFO: `/v3/projects/b7aa834667ed445eba7561ef6fd2d3c6` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:51.058212 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e62c3ea-84e1-437c-b559-46332944e27d None admin] RBAC: Authorizing `identity:get_project(project_id=b7aa834667ed445eba7561ef6fd2d3c6)` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:20:51.059788 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e62c3ea-84e1-437c-b559-46332944e27d None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:20:51.061771 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 64/125] 10.222.0.18 () {56 vars in 1186 bytes} [Sat Sep 24 19:20:50 2022] GET /identity/v3/projects/b7aa834667ed445eba7561ef6fd2d3c6 => generated 298 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:20:51.062451 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e62c3ea-84e1-437c-b559-46332944e27d None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:20:51.072798 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1d6fbb-0b1a-49da-b45e-e13816acb004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:20:51.074015 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1d6fbb-0b1a-49da-b45e-e13816acb004 None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:51.074514 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1d6fbb-0b1a-49da-b45e-e13816acb004 None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:51.075030 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1d6fbb-0b1a-49da-b45e-e13816acb004 None admin] PATH_INFO: `/v3/users/6fe4c395bf344558954904e47a38c49e` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:51.076607 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1d6fbb-0b1a-49da-b45e-e13816acb004 None admin] RBAC: Authorizing `identity:get_user(user_id=6fe4c395bf344558954904e47a38c49e)` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:20:51.078617 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1d6fbb-0b1a-49da-b45e-e13816acb004 None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:20:51.080771 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 62/126] 10.222.0.18 () {56 vars in 1177 bytes} [Sat Sep 24 19:20:50 2022] GET /identity/v3/users/6fe4c395bf344558954904e47a38c49e => generated 275 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:20:51.082157 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1d6fbb-0b1a-49da-b45e-e13816acb004 None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:20:51.121672 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:20:51.179519 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:20:51.228549 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e62c3ea-84e1-437c-b559-46332944e27d None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:20:51.240608 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1d6fbb-0b1a-49da-b45e-e13816acb004 None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:20:51.300139 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d2216e-e2f6-47fe-ae63-462a9d3b58b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:20:51.300883 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d2216e-e2f6-47fe-ae63-462a9d3b58b8 None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:51.301349 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d2216e-e2f6-47fe-ae63-462a9d3b58b8 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:51.301808 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d2216e-e2f6-47fe-ae63-462a9d3b58b8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:51.304493 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf6ad6c-302c-47dc-bbbf-7990e7d9ee8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:20:51.305542 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf6ad6c-302c-47dc-bbbf-7990e7d9ee8b None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:51.306052 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf6ad6c-302c-47dc-bbbf-7990e7d9ee8b None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:51.306505 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf6ad6c-302c-47dc-bbbf-7990e7d9ee8b None admin] PATH_INFO: `/v3/users/6fe4c395bf344558954904e47a38c49e` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:51.308336 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf6ad6c-302c-47dc-bbbf-7990e7d9ee8b None admin] RBAC: Authorizing `identity:get_user(user_id=6fe4c395bf344558954904e47a38c49e)` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:20:51.310970 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf6ad6c-302c-47dc-bbbf-7990e7d9ee8b None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:20:51.313685 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 63/127] 10.222.0.18 () {56 vars in 1177 bytes} [Sat Sep 24 19:20:51 2022] GET /identity/v3/users/6fe4c395bf344558954904e47a38c49e => generated 275 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:20:51.315117 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf6ad6c-302c-47dc-bbbf-7990e7d9ee8b None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:20:51.323259 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d2216e-e2f6-47fe-ae63-462a9d3b58b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:20:51.332416 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application [None req-b8d2216e-e2f6-47fe-ae63-462a9d3b58b8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 24 19:20:51.332416 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:20:51.332416 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:20:51.332416 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:20:51.332416 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:20:51.332416 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:20:51.332416 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:20:51.332416 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:20:51.332416 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:20:51.332416 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:20:51.332416 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:20:51.332416 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:20:51.332416 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:20:51.332416 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:20:51.332416 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:20:51.332416 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:20:51.333294 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:20:51.333294 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:20:51.333294 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:20:51.333294 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:20:51.333294 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:20:51.333294 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:20:51.333294 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:20:51.333294 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:20:51.333294 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:20:51.333294 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:20:51.333294 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:20:51.333294 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application with Lock( Sep 24 19:20:51.333294 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:20:51.333294 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:20:51.333294 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:20:51.333294 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:20:51.334262 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:20:51.334262 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:20:51.334262 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:20:51.334262 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:20:51.334262 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:20:51.334262 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:20:51.334262 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:20:51.334262 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:20:51.334262 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:20:51.334262 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:20:51.334262 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 24 19:20:51.334262 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Sep 24 19:20:51.335919 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 65/128] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Sep 24 19:20:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:20:51.335919 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d2216e-e2f6-47fe-ae63-462a9d3b58b8 None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:20:51.428727 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf6ad6c-302c-47dc-bbbf-7990e7d9ee8b None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:20:51.467879 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d2216e-e2f6-47fe-ae63-462a9d3b58b8 None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:20:51.471653 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:20:51.473559 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458e80f0-b482-48c7-8643-fc536676f72d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:20:51.474885 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458e80f0-b482-48c7-8643-fc536676f72d None admin] REQUEST_METHOD: `PUT` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:51.475426 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458e80f0-b482-48c7-8643-fc536676f72d None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:51.475897 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458e80f0-b482-48c7-8643-fc536676f72d None admin] PATH_INFO: `/v3/projects/b7aa834667ed445eba7561ef6fd2d3c6/users/3dbbb9909cec43ff99c1c3682f016ef8/roles/4c7d0dafc19b4b0a9821be6ec0da0a8f` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:51.479862 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458e80f0-b482-48c7-8643-fc536676f72d None admin] RBAC: Authorizing `identity:create_grant(project_id=b7aa834667ed445eba7561ef6fd2d3c6, user_id=3dbbb9909cec43ff99c1c3682f016ef8, role_id=4c7d0dafc19b4b0a9821be6ec0da0a8f)` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:20:51.483011 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458e80f0-b482-48c7-8643-fc536676f72d None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:20:51.491468 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:20:51.510338 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 64/129] 10.222.0.18 () {58 vars in 1439 bytes} [Sat Sep 24 19:20:51 2022] PUT /identity/v3/projects/b7aa834667ed445eba7561ef6fd2d3c6/users/3dbbb9909cec43ff99c1c3682f016ef8/roles/4c7d0dafc19b4b0a9821be6ec0da0a8f => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:20:51.511730 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458e80f0-b482-48c7-8643-fc536676f72d None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:20:51.513431 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0c3d7d-9cb2-401a-9ddf-06d051500986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:20:51.514222 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0c3d7d-9cb2-401a-9ddf-06d051500986 None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:51.514608 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0c3d7d-9cb2-401a-9ddf-06d051500986 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:51.514961 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0c3d7d-9cb2-401a-9ddf-06d051500986 None admin] PATH_INFO: `/v3/projects/b7aa834667ed445eba7561ef6fd2d3c6` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:51.517743 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0c3d7d-9cb2-401a-9ddf-06d051500986 None admin] RBAC: Authorizing `identity:get_project(project_id=b7aa834667ed445eba7561ef6fd2d3c6)` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:20:51.519561 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0c3d7d-9cb2-401a-9ddf-06d051500986 None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:20:51.526814 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 66/130] 10.222.0.18 () {56 vars in 1186 bytes} [Sat Sep 24 19:20:51 2022] GET /identity/v3/projects/b7aa834667ed445eba7561ef6fd2d3c6 => generated 298 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:20:51.526814 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0c3d7d-9cb2-401a-9ddf-06d051500986 None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:20:51.721965 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0c3d7d-9cb2-401a-9ddf-06d051500986 None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:20:51.735966 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458e80f0-b482-48c7-8643-fc536676f72d None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:20:51.770011 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5916114c-49ce-460a-8d5f-262d97e69a5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:20:51.773630 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5916114c-49ce-460a-8d5f-262d97e69a5a None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:51.773630 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5916114c-49ce-460a-8d5f-262d97e69a5a None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:51.773630 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5916114c-49ce-460a-8d5f-262d97e69a5a None admin] PATH_INFO: `/v3/roles` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:51.773630 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5916114c-49ce-460a-8d5f-262d97e69a5a None admin] RBAC: Adding query filter params (name=member) {{(pid=88081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:20:51.773630 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5916114c-49ce-460a-8d5f-262d97e69a5a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:20:51.774109 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5916114c-49ce-460a-8d5f-262d97e69a5a None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:20:51.784117 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 67/131] 10.222.0.18 () {56 vars in 1101 bytes} [Sat Sep 24 19:20:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:20:51.786645 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5916114c-49ce-460a-8d5f-262d97e69a5a None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:20:51.790869 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee8a71c-a472-4dfc-a041-9fa4cd1d157d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:20:51.792542 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee8a71c-a472-4dfc-a041-9fa4cd1d157d None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:51.792835 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee8a71c-a472-4dfc-a041-9fa4cd1d157d None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:51.793109 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee8a71c-a472-4dfc-a041-9fa4cd1d157d None admin] PATH_INFO: `/v3/projects/b7aa834667ed445eba7561ef6fd2d3c6` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:51.795047 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee8a71c-a472-4dfc-a041-9fa4cd1d157d None admin] RBAC: Authorizing `identity:get_project(project_id=b7aa834667ed445eba7561ef6fd2d3c6)` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:20:51.796520 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee8a71c-a472-4dfc-a041-9fa4cd1d157d None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:20:51.798233 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 65/132] 10.222.0.18 () {56 vars in 1186 bytes} [Sat Sep 24 19:20:51 2022] GET /identity/v3/projects/b7aa834667ed445eba7561ef6fd2d3c6 => generated 298 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:20:51.799908 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee8a71c-a472-4dfc-a041-9fa4cd1d157d None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:20:51.832685 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:20:51.883253 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:20:51.914835 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5916114c-49ce-460a-8d5f-262d97e69a5a None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:20:51.939420 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee8a71c-a472-4dfc-a041-9fa4cd1d157d None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:20:51.952769 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9f9db8-c908-4b48-a09e-747bfcfc840e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:20:51.953609 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9f9db8-c908-4b48-a09e-747bfcfc840e None admin] REQUEST_METHOD: `PUT` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:51.954285 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9f9db8-c908-4b48-a09e-747bfcfc840e None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:51.954565 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9f9db8-c908-4b48-a09e-747bfcfc840e None admin] PATH_INFO: `/v3/projects/b7aa834667ed445eba7561ef6fd2d3c6/users/6fe4c395bf344558954904e47a38c49e/roles/3a42524fc57c4487a34c5c05234413a7` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:51.956488 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9f9db8-c908-4b48-a09e-747bfcfc840e None admin] RBAC: Authorizing `identity:create_grant(project_id=b7aa834667ed445eba7561ef6fd2d3c6, user_id=6fe4c395bf344558954904e47a38c49e, role_id=3a42524fc57c4487a34c5c05234413a7)` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:20:51.957961 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9f9db8-c908-4b48-a09e-747bfcfc840e None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:20:51.984120 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 68/133] 10.222.0.18 () {58 vars in 1439 bytes} [Sat Sep 24 19:20:51 2022] PUT /identity/v3/projects/b7aa834667ed445eba7561ef6fd2d3c6/users/6fe4c395bf344558954904e47a38c49e/roles/3a42524fc57c4487a34c5c05234413a7 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:20:51.985081 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9f9db8-c908-4b48-a09e-747bfcfc840e None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:20:52.004043 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231bfd7c-31ab-4739-8d19-6c9f7a136b14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:20:52.004686 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231bfd7c-31ab-4739-8d19-6c9f7a136b14 None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:52.007282 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231bfd7c-31ab-4739-8d19-6c9f7a136b14 None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:52.007564 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231bfd7c-31ab-4739-8d19-6c9f7a136b14 None admin] PATH_INFO: `/v3/users/6fe4c395bf344558954904e47a38c49e` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:52.008882 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231bfd7c-31ab-4739-8d19-6c9f7a136b14 None admin] RBAC: Authorizing `identity:get_user(user_id=6fe4c395bf344558954904e47a38c49e)` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:20:52.010358 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231bfd7c-31ab-4739-8d19-6c9f7a136b14 None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:20:52.014299 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 66/134] 10.222.0.18 () {56 vars in 1177 bytes} [Sat Sep 24 19:20:51 2022] GET /identity/v3/users/6fe4c395bf344558954904e47a38c49e => generated 275 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:20:52.021562 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231bfd7c-31ab-4739-8d19-6c9f7a136b14 None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:20:52.162804 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231bfd7c-31ab-4739-8d19-6c9f7a136b14 None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:20:52.202159 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:20:52.212298 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b41dfb5-4289-407b-9257-d83b329d9f62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:20:52.213026 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b41dfb5-4289-407b-9257-d83b329d9f62 None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:52.213329 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b41dfb5-4289-407b-9257-d83b329d9f62 None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:52.213602 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b41dfb5-4289-407b-9257-d83b329d9f62 None admin] PATH_INFO: `/v3/projects/a7b33840413d4f388f2510aecd344eec` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:52.215403 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b41dfb5-4289-407b-9257-d83b329d9f62 None admin] RBAC: Authorizing `identity:get_project(project_id=a7b33840413d4f388f2510aecd344eec)` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:20:52.216916 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b41dfb5-4289-407b-9257-d83b329d9f62 None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:20:52.222593 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 67/135] 10.222.0.18 () {56 vars in 1186 bytes} [Sat Sep 24 19:20:52 2022] GET /identity/v3/projects/a7b33840413d4f388f2510aecd344eec => generated 312 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:20:52.225684 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b41dfb5-4289-407b-9257-d83b329d9f62 None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:20:52.263668 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:20:52.295898 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9f9db8-c908-4b48-a09e-747bfcfc840e None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:20:52.360620 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b41dfb5-4289-407b-9257-d83b329d9f62 None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:20:52.378614 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8c3394-ea8e-46aa-bc6c-161bbb968a92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:20:52.379539 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8c3394-ea8e-46aa-bc6c-161bbb968a92 None admin] REQUEST_METHOD: `PUT` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:52.379768 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8c3394-ea8e-46aa-bc6c-161bbb968a92 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:52.380050 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8c3394-ea8e-46aa-bc6c-161bbb968a92 None admin] PATH_INFO: `/v3/projects/b7aa834667ed445eba7561ef6fd2d3c6/users/6fe4c395bf344558954904e47a38c49e/roles/a24280fb630f4c17865458d833144b17` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:52.382710 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8c3394-ea8e-46aa-bc6c-161bbb968a92 None admin] RBAC: Authorizing `identity:create_grant(project_id=b7aa834667ed445eba7561ef6fd2d3c6, user_id=6fe4c395bf344558954904e47a38c49e, role_id=a24280fb630f4c17865458d833144b17)` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:20:52.384288 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8c3394-ea8e-46aa-bc6c-161bbb968a92 None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:20:52.397460 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cd85b2-5edf-4905-af26-acaa6800e1d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:20:52.398211 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cd85b2-5edf-4905-af26-acaa6800e1d8 None admin] REQUEST_METHOD: `PUT` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:52.398486 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cd85b2-5edf-4905-af26-acaa6800e1d8 None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:52.398757 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cd85b2-5edf-4905-af26-acaa6800e1d8 None admin] PATH_INFO: `/v3/projects/a7b33840413d4f388f2510aecd344eec/users/6fe4c395bf344558954904e47a38c49e/roles/3a42524fc57c4487a34c5c05234413a7` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:52.400921 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cd85b2-5edf-4905-af26-acaa6800e1d8 None admin] RBAC: Authorizing `identity:create_grant(project_id=a7b33840413d4f388f2510aecd344eec, user_id=6fe4c395bf344558954904e47a38c49e, role_id=3a42524fc57c4487a34c5c05234413a7)` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:20:52.401937 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 69/136] 10.222.0.18 () {58 vars in 1439 bytes} [Sat Sep 24 19:20:51 2022] PUT /identity/v3/projects/b7aa834667ed445eba7561ef6fd2d3c6/users/6fe4c395bf344558954904e47a38c49e/roles/a24280fb630f4c17865458d833144b17 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:20:52.402577 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cd85b2-5edf-4905-af26-acaa6800e1d8 None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:20:52.402985 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357ccb93-494f-4620-95ee-d1ecb084e618 None None] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:52.410394 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357ccb93-494f-4620-95ee-d1ecb084e618 None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:52.410905 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357ccb93-494f-4620-95ee-d1ecb084e618 None None] PATH_INFO: `/` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:52.413489 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 70/137] 10.222.0.18 () {54 vars in 927 bytes} [Sat Sep 24 19:20:52 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:20:52.425333 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 68/138] 10.222.0.18 () {58 vars in 1439 bytes} [Sat Sep 24 19:20:52 2022] PUT /identity/v3/projects/a7b33840413d4f388f2510aecd344eec/users/6fe4c395bf344558954904e47a38c49e/roles/3a42524fc57c4487a34c5c05234413a7 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:20:52.429591 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7be9cd5-4a28-4930-90e4-f5988beff0b1 None None] REQUEST_METHOD: `POST` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:52.430030 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7be9cd5-4a28-4930-90e4-f5988beff0b1 None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:52.430376 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7be9cd5-4a28-4930-90e4-f5988beff0b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:52.463270 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.auth.core [None req-c7be9cd5-4a28-4930-90e4-f5988beff0b1 None None] MFA Rules not processed for user `3dbbb9909cec43ff99c1c3682f016ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=88081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:20:52.464984 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.fernet_utils [None req-c7be9cd5-4a28-4930-90e4-f5988beff0b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:20:52.576326 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 71/139] 10.222.0.18 () {58 vars in 1024 bytes} [Sat Sep 24 19:20:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:20:53.102909 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cd85b2-5edf-4905-af26-acaa6800e1d8 None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:20:53.190842 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:20:53.241597 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cd85b2-5edf-4905-af26-acaa6800e1d8 None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:20:53.295525 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a130a28b-f69e-4e08-adb5-c72c5cd37fe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:20:53.296186 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a130a28b-f69e-4e08-adb5-c72c5cd37fe3 None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:53.296465 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a130a28b-f69e-4e08-adb5-c72c5cd37fe3 None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:53.296736 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a130a28b-f69e-4e08-adb5-c72c5cd37fe3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:53.297894 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a130a28b-f69e-4e08-adb5-c72c5cd37fe3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:20:53.299371 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a130a28b-f69e-4e08-adb5-c72c5cd37fe3 None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:20:53.301119 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 69/140] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Sep 24 19:20:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:20:53.307124 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7be9cd5-4a28-4930-90e4-f5988beff0b1 None None] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:20:53.442728 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:20:53.468235 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7be9cd5-4a28-4930-90e4-f5988beff0b1 None None] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:20:53.516035 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f7fcf4-c19a-4e4a-bd70-6f9c76c0e67c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:20:53.516655 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f7fcf4-c19a-4e4a-bd70-6f9c76c0e67c None admin] REQUEST_METHOD: `POST` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:53.516935 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f7fcf4-c19a-4e4a-bd70-6f9c76c0e67c None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:53.517201 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f7fcf4-c19a-4e4a-bd70-6f9c76c0e67c None admin] PATH_INFO: `/v3/users` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:53.517943 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f7fcf4-c19a-4e4a-bd70-6f9c76c0e67c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:20:53.519463 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f7fcf4-c19a-4e4a-bd70-6f9c76c0e67c None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:20:53.550233 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 72/141] 10.222.0.18 () {60 vars in 1132 bytes} [Sat Sep 24 19:20:53 2022] POST /identity/v3/users => generated 283 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:20:54.291861 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26009dc7-1dca-46b1-9dda-27f237170375 None None] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:54.292387 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26009dc7-1dca-46b1-9dda-27f237170375 None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:54.292387 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26009dc7-1dca-46b1-9dda-27f237170375 None None] PATH_INFO: `/` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:54.294016 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 70/142] 10.222.0.18 () {54 vars in 927 bytes} [Sat Sep 24 19:20:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:20:54.306697 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4ac1ca-0580-4903-861e-9843d2272a79 None None] REQUEST_METHOD: `POST` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:54.306988 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4ac1ca-0580-4903-861e-9843d2272a79 None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:54.307266 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4ac1ca-0580-4903-861e-9843d2272a79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:54.332856 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.auth.core [None req-3e4ac1ca-0580-4903-861e-9843d2272a79 None None] MFA Rules not processed for user `3dbbb9909cec43ff99c1c3682f016ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=88081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:20:54.334135 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.fernet_utils [None req-3e4ac1ca-0580-4903-861e-9843d2272a79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:20:54.418007 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 73/143] 10.222.0.18 () {58 vars in 1024 bytes} [Sat Sep 24 19:20:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:20:54.651660 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bf1715-d244-4b78-9ced-9576a967b857 None None] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:54.652123 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bf1715-d244-4b78-9ced-9576a967b857 None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:54.652602 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bf1715-d244-4b78-9ced-9576a967b857 None None] PATH_INFO: `/` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:54.655449 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 71/144] 10.222.0.18 () {54 vars in 927 bytes} [Sat Sep 24 19:20:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:20:54.662241 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1f2ce0-bb4f-4cc5-bd6a-d9b408f70609 None None] REQUEST_METHOD: `POST` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:54.662721 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1f2ce0-bb4f-4cc5-bd6a-d9b408f70609 None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:54.663211 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1f2ce0-bb4f-4cc5-bd6a-d9b408f70609 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:54.703688 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.auth.core [None req-cf1f2ce0-bb4f-4cc5-bd6a-d9b408f70609 None None] MFA Rules not processed for user `3dbbb9909cec43ff99c1c3682f016ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=88081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:20:54.705635 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.fernet_utils [None req-cf1f2ce0-bb4f-4cc5-bd6a-d9b408f70609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:20:54.865181 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:20:54.872519 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 74/145] 10.222.0.18 () {58 vars in 1024 bytes} [Sat Sep 24 19:20:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:20:55.220571 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bf1715-d244-4b78-9ced-9576a967b857 None None] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:20:55.452592 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bf1715-d244-4b78-9ced-9576a967b857 None None] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:20:55.502790 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:20:55.519077 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea77bd1d-b65c-417a-9053-73f52065c55c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:20:55.520119 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea77bd1d-b65c-417a-9053-73f52065c55c None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:55.520597 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea77bd1d-b65c-417a-9053-73f52065c55c None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:55.521677 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea77bd1d-b65c-417a-9053-73f52065c55c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:55.535790 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea77bd1d-b65c-417a-9053-73f52065c55c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:20:55.543592 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1f2ce0-bb4f-4cc5-bd6a-d9b408f70609 None None] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:20:55.545780 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application [None req-ea77bd1d-b65c-417a-9053-73f52065c55c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 24 19:20:55.545780 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:20:55.545780 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:20:55.545780 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:20:55.545780 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:20:55.545780 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:20:55.545780 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:20:55.545780 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:20:55.545780 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:20:55.545780 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:20:55.545780 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:20:55.545780 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:20:55.545780 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:20:55.545780 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:20:55.545780 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:20:55.545780 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:20:55.547312 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:20:55.547312 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:20:55.547312 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:20:55.547312 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:20:55.547312 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:20:55.547312 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:20:55.547312 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:20:55.547312 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:20:55.547312 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:20:55.547312 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:20:55.547312 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:20:55.547312 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application with Lock( Sep 24 19:20:55.547312 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:20:55.547312 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:20:55.547312 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:20:55.547312 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:20:55.548604 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:20:55.548604 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:20:55.548604 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:20:55.548604 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:20:55.548604 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:20:55.548604 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:20:55.548604 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:20:55.548604 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:20:55.548604 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:20:55.548604 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:20:55.548604 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 24 19:20:55.548604 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Sep 24 19:20:55.552969 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 72/146] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Sep 24 19:20:55 2022] GET /identity/v3/roles/reader => generated 84 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:20:55.562376 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea77bd1d-b65c-417a-9053-73f52065c55c None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:20:55.740903 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1f2ce0-bb4f-4cc5-bd6a-d9b408f70609 None None] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:20:55.766387 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea77bd1d-b65c-417a-9053-73f52065c55c None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:20:55.778477 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d631aad-3550-4009-84db-59daaffca1b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:20:55.779115 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d631aad-3550-4009-84db-59daaffca1b4 None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:55.779392 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d631aad-3550-4009-84db-59daaffca1b4 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:55.779960 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d631aad-3550-4009-84db-59daaffca1b4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:55.793330 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d631aad-3550-4009-84db-59daaffca1b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:20:55.798677 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application [None req-5d631aad-3550-4009-84db-59daaffca1b4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 19:20:55.798677 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:20:55.798677 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:20:55.798677 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:20:55.798677 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:20:55.798677 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:20:55.798677 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:20:55.798677 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:20:55.798677 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:20:55.798677 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:20:55.798677 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:20:55.798677 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:20:55.798677 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:20:55.798677 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:20:55.798677 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:20:55.798677 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:20:55.799556 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:20:55.799556 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:20:55.799556 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:20:55.799556 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:20:55.799556 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:20:55.799556 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:20:55.799556 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:20:55.799556 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:20:55.799556 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:20:55.799556 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:20:55.799556 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:20:55.799556 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application with Lock( Sep 24 19:20:55.799556 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:20:55.799556 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:20:55.799556 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:20:55.799556 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:20:55.800307 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:20:55.800307 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:20:55.800307 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:20:55.800307 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:20:55.800307 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:20:55.800307 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:20:55.800307 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:20:55.800307 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:20:55.800307 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:20:55.800307 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:20:55.800307 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 19:20:55.800307 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Sep 24 19:20:55.800307 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 75/147] 10.222.0.18 () {56 vars in 1096 bytes} [Sat Sep 24 19:20:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:20:55.808716 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d631aad-3550-4009-84db-59daaffca1b4 None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:20:55.843146 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b985eb-4038-42e7-af81-b4742d6ef17e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:20:55.843762 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b985eb-4038-42e7-af81-b4742d6ef17e None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:55.845842 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b985eb-4038-42e7-af81-b4742d6ef17e None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:55.846128 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b985eb-4038-42e7-af81-b4742d6ef17e None admin] PATH_INFO: `/v3/roles` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:55.846818 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b985eb-4038-42e7-af81-b4742d6ef17e None admin] RBAC: Adding query filter params (name=reader) {{(pid=88080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:20:55.847118 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b985eb-4038-42e7-af81-b4742d6ef17e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:20:55.848551 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b985eb-4038-42e7-af81-b4742d6ef17e None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:20:55.866964 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 73/148] 10.222.0.18 () {56 vars in 1101 bytes} [Sat Sep 24 19:20:55 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:20:55.873389 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b985eb-4038-42e7-af81-b4742d6ef17e None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:20:55.940768 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:20:56.003568 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b985eb-4038-42e7-af81-b4742d6ef17e None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:20:56.011977 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:20:56.046057 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7540358-e190-4560-b2dd-86e904bceaab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:20:56.046998 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7540358-e190-4560-b2dd-86e904bceaab None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:56.047279 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7540358-e190-4560-b2dd-86e904bceaab None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:56.047551 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7540358-e190-4560-b2dd-86e904bceaab None admin] PATH_INFO: `/v3/users/d5e4d93077134f6193a6cf0d9b2cc1f8` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:56.048702 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7540358-e190-4560-b2dd-86e904bceaab None admin] RBAC: Authorizing `identity:get_user(user_id=d5e4d93077134f6193a6cf0d9b2cc1f8)` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:20:56.050324 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7540358-e190-4560-b2dd-86e904bceaab None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:20:56.056985 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 74/149] 10.222.0.18 () {56 vars in 1177 bytes} [Sat Sep 24 19:20:55 2022] GET /identity/v3/users/d5e4d93077134f6193a6cf0d9b2cc1f8 => generated 289 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:20:56.058504 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7540358-e190-4560-b2dd-86e904bceaab None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:20:56.165397 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d631aad-3550-4009-84db-59daaffca1b4 None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:20:56.190866 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7540358-e190-4560-b2dd-86e904bceaab None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:20:56.216208 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:20:56.244860 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7e7203-3df5-40f2-9526-e53659cf24b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:20:56.245617 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7e7203-3df5-40f2-9526-e53659cf24b6 None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:56.245883 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7e7203-3df5-40f2-9526-e53659cf24b6 None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:56.246154 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7e7203-3df5-40f2-9526-e53659cf24b6 None admin] PATH_INFO: `/v3/projects/b7aa834667ed445eba7561ef6fd2d3c6` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:56.247342 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7e7203-3df5-40f2-9526-e53659cf24b6 None admin] RBAC: Authorizing `identity:get_project(project_id=b7aa834667ed445eba7561ef6fd2d3c6)` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:20:56.248938 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7e7203-3df5-40f2-9526-e53659cf24b6 None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:20:56.255973 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 75/150] 10.222.0.18 () {56 vars in 1186 bytes} [Sat Sep 24 19:20:56 2022] GET /identity/v3/projects/b7aa834667ed445eba7561ef6fd2d3c6 => generated 298 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:20:56.259927 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7e7203-3df5-40f2-9526-e53659cf24b6 None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:20:56.291891 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcc6a87-3937-4369-8030-cb58746a8ccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:20:56.292834 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcc6a87-3937-4369-8030-cb58746a8ccf None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:56.293322 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcc6a87-3937-4369-8030-cb58746a8ccf None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:56.293793 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcc6a87-3937-4369-8030-cb58746a8ccf None admin] PATH_INFO: `/v3/roles` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:56.295003 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcc6a87-3937-4369-8030-cb58746a8ccf None admin] RBAC: Adding query filter params (name=admin) {{(pid=88081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:20:56.295539 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcc6a87-3937-4369-8030-cb58746a8ccf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:20:56.298147 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcc6a87-3937-4369-8030-cb58746a8ccf None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:20:56.323851 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 76/151] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Sep 24 19:20:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 515 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:20:56.333516 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcc6a87-3937-4369-8030-cb58746a8ccf None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:20:56.410705 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7e7203-3df5-40f2-9526-e53659cf24b6 None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:20:56.479737 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74382097-9a6c-433e-a748-2c03b951f4f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:20:56.482020 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74382097-9a6c-433e-a748-2c03b951f4f0 None admin] REQUEST_METHOD: `PUT` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:56.482569 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74382097-9a6c-433e-a748-2c03b951f4f0 None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:56.483072 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74382097-9a6c-433e-a748-2c03b951f4f0 None admin] PATH_INFO: `/v3/projects/b7aa834667ed445eba7561ef6fd2d3c6/users/d5e4d93077134f6193a6cf0d9b2cc1f8/roles/f072ea6ff7ca4dbf90174c318d19acf1` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:56.491656 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74382097-9a6c-433e-a748-2c03b951f4f0 None admin] RBAC: Authorizing `identity:create_grant(project_id=b7aa834667ed445eba7561ef6fd2d3c6, user_id=d5e4d93077134f6193a6cf0d9b2cc1f8, role_id=f072ea6ff7ca4dbf90174c318d19acf1)` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:20:56.494372 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74382097-9a6c-433e-a748-2c03b951f4f0 None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:20:56.522776 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 76/152] 10.222.0.18 () {58 vars in 1439 bytes} [Sat Sep 24 19:20:56 2022] PUT /identity/v3/projects/b7aa834667ed445eba7561ef6fd2d3c6/users/d5e4d93077134f6193a6cf0d9b2cc1f8/roles/f072ea6ff7ca4dbf90174c318d19acf1 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:20:56.652701 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcc6a87-3937-4369-8030-cb58746a8ccf None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:20:56.703741 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea2b4ac-3944-48f8-98fa-2e1e06ee2ba1 None None] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:56.704125 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea2b4ac-3944-48f8-98fa-2e1e06ee2ba1 None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:56.704474 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea2b4ac-3944-48f8-98fa-2e1e06ee2ba1 None None] PATH_INFO: `/` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:56.705893 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 77/153] 10.222.0.18 () {54 vars in 927 bytes} [Sat Sep 24 19:20:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:20:56.709608 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:20:56.724414 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332bfedf-05a9-4b80-b884-4375f0e64671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:20:56.725058 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332bfedf-05a9-4b80-b884-4375f0e64671 None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:56.725333 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332bfedf-05a9-4b80-b884-4375f0e64671 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:56.725602 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332bfedf-05a9-4b80-b884-4375f0e64671 None admin] PATH_INFO: `/v3/users/3dbbb9909cec43ff99c1c3682f016ef8` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:56.726867 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332bfedf-05a9-4b80-b884-4375f0e64671 None admin] RBAC: Authorizing `identity:get_user(user_id=3dbbb9909cec43ff99c1c3682f016ef8)` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:20:56.728448 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332bfedf-05a9-4b80-b884-4375f0e64671 None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:20:56.730166 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 77/154] 10.222.0.18 () {56 vars in 1177 bytes} [Sat Sep 24 19:20:56 2022] GET /identity/v3/users/3dbbb9909cec43ff99c1c3682f016ef8 => generated 247 bytes in 398 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:20:56.734609 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c131219d-c3f0-450e-aed0-e1338740dd8a None None] REQUEST_METHOD: `POST` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:56.734900 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c131219d-c3f0-450e-aed0-e1338740dd8a None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:56.735156 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c131219d-c3f0-450e-aed0-e1338740dd8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:56.738489 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332bfedf-05a9-4b80-b884-4375f0e64671 None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:20:56.779417 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.auth.core [None req-c131219d-c3f0-450e-aed0-e1338740dd8a None None] MFA Rules not processed for user `3dbbb9909cec43ff99c1c3682f016ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=88080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:20:56.781246 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.fernet_utils [None req-c131219d-c3f0-450e-aed0-e1338740dd8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:20:56.941535 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:20:56.950066 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332bfedf-05a9-4b80-b884-4375f0e64671 None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:20:57.014838 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ea0049-5f08-44d5-8066-941cf9bf3919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:20:57.015520 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ea0049-5f08-44d5-8066-941cf9bf3919 None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:57.015803 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ea0049-5f08-44d5-8066-941cf9bf3919 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:57.016071 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ea0049-5f08-44d5-8066-941cf9bf3919 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:57.037354 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 78/155] 10.222.0.18 () {58 vars in 1024 bytes} [Sat Sep 24 19:20:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 24 19:20:57.115747 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:20:57.133511 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ea0049-5f08-44d5-8066-941cf9bf3919 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:20:57.135014 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ea0049-5f08-44d5-8066-941cf9bf3919 None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:20:57.254886 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 78/156] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Sep 24 19:20:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 517 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 24 19:20:57.260779 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c131219d-c3f0-450e-aed0-e1338740dd8a None None] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:20:57.397556 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c131219d-c3f0-450e-aed0-e1338740dd8a None None] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:20:57.446386 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b0683a-78c3-434f-9712-3705d368a821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:20:57.447025 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b0683a-78c3-434f-9712-3705d368a821 None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:57.447300 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b0683a-78c3-434f-9712-3705d368a821 None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:57.447565 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b0683a-78c3-434f-9712-3705d368a821 None admin] PATH_INFO: `/v3/projects/b7aa834667ed445eba7561ef6fd2d3c6` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:57.448717 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b0683a-78c3-434f-9712-3705d368a821 None admin] RBAC: Authorizing `identity:get_project(project_id=b7aa834667ed445eba7561ef6fd2d3c6)` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:20:57.450190 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b0683a-78c3-434f-9712-3705d368a821 None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:20:57.452051 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 79/157] 10.222.0.18 () {56 vars in 1186 bytes} [Sat Sep 24 19:20:57 2022] GET /identity/v3/projects/b7aa834667ed445eba7561ef6fd2d3c6 => generated 298 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:20:57.457799 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ea0049-5f08-44d5-8066-941cf9bf3919 None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:20:57.580712 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:20:57.590537 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ea0049-5f08-44d5-8066-941cf9bf3919 None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:20:57.625005 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c046e2-a873-4a09-ac4e-63fab1fc52fc None None] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:57.625572 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c046e2-a873-4a09-ac4e-63fab1fc52fc None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:57.625572 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c046e2-a873-4a09-ac4e-63fab1fc52fc None None] PATH_INFO: `/` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:57.627212 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 80/158] 10.222.0.18 () {54 vars in 927 bytes} [Sat Sep 24 19:20:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 24 19:20:57.633083 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfae1421-14c0-4f6b-9b84-32bf2d495e11 None None] REQUEST_METHOD: `POST` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:57.633377 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfae1421-14c0-4f6b-9b84-32bf2d495e11 None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:57.633572 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfae1421-14c0-4f6b-9b84-32bf2d495e11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:57.651166 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5b4e93-4f6e-4b60-ab23-ebb96c7ed967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:20:57.651832 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5b4e93-4f6e-4b60-ab23-ebb96c7ed967 None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:57.652111 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5b4e93-4f6e-4b60-ab23-ebb96c7ed967 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:57.652512 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5b4e93-4f6e-4b60-ab23-ebb96c7ed967 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:57.653284 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5b4e93-4f6e-4b60-ab23-ebb96c7ed967 None admin] RBAC: Adding query filter params (role.id=4c7d0dafc19b4b0a9821be6ec0da0a8f, scope.project.id=b7aa834667ed445eba7561ef6fd2d3c6, user.id=3dbbb9909cec43ff99c1c3682f016ef8) {{(pid=88081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:20:57.654009 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5b4e93-4f6e-4b60-ab23-ebb96c7ed967 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:20:57.655393 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5b4e93-4f6e-4b60-ab23-ebb96c7ed967 None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:20:57.667439 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 79/159] 10.222.0.18 () {56 vars in 1374 bytes} [Sat Sep 24 19:20:57 2022] GET /identity/v3/role_assignments?user.id=3dbbb9909cec43ff99c1c3682f016ef8&scope.project.id=b7aa834667ed445eba7561ef6fd2d3c6&role.id=4c7d0dafc19b4b0a9821be6ec0da0a8f => generated 608 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:20:57.682287 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.auth.core [None req-dfae1421-14c0-4f6b-9b84-32bf2d495e11 None None] MFA Rules not processed for user `3dbbb9909cec43ff99c1c3682f016ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=88080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:20:57.683542 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.fernet_utils [None req-dfae1421-14c0-4f6b-9b84-32bf2d495e11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:20:57.796393 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:20:57.833481 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 81/160] 10.222.0.18 () {58 vars in 1024 bytes} [Sat Sep 24 19:20:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 24 19:20:57.913191 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f28a8e1-5062-4c19-acad-0a7eb1501fd3 None None] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:57.913474 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f28a8e1-5062-4c19-acad-0a7eb1501fd3 None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:57.913735 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f28a8e1-5062-4c19-acad-0a7eb1501fd3 None None] PATH_INFO: `/` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:57.915140 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 80/161] 10.222.0.18 () {54 vars in 927 bytes} [Sat Sep 24 19:20:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:20:57.924369 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2cf065-fa65-4444-a74c-7c70d5305505 None None] REQUEST_METHOD: `POST` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:57.924649 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2cf065-fa65-4444-a74c-7c70d5305505 None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:57.924961 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2cf065-fa65-4444-a74c-7c70d5305505 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:57.959110 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.auth.core [None req-8e2cf065-fa65-4444-a74c-7c70d5305505 None None] MFA Rules not processed for user `3dbbb9909cec43ff99c1c3682f016ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=88080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:20:57.960351 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.fernet_utils [None req-8e2cf065-fa65-4444-a74c-7c70d5305505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:20:58.050824 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 82/162] 10.222.0.18 () {58 vars in 1024 bytes} [Sat Sep 24 19:20:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 24 19:20:58.052930 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f28a8e1-5062-4c19-acad-0a7eb1501fd3 None None] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:20:58.260978 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f28a8e1-5062-4c19-acad-0a7eb1501fd3 None None] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:20:58.307183 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33af1def-d510-4cf0-a19d-1f5510736984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:20:58.311216 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33af1def-d510-4cf0-a19d-1f5510736984 None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:58.311999 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33af1def-d510-4cf0-a19d-1f5510736984 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:58.312618 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33af1def-d510-4cf0-a19d-1f5510736984 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:58.331971 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33af1def-d510-4cf0-a19d-1f5510736984 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:20:58.338626 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application [None req-33af1def-d510-4cf0-a19d-1f5510736984 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 24 19:20:58.338626 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:20:58.338626 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:20:58.338626 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:20:58.338626 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:20:58.338626 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:20:58.338626 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:20:58.338626 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:20:58.338626 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:20:58.338626 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:20:58.338626 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:20:58.338626 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:20:58.338626 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:20:58.338626 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:20:58.338626 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:20:58.338626 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:20:58.339921 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:20:58.339921 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:20:58.339921 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:20:58.339921 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:20:58.339921 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:20:58.339921 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:20:58.339921 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:20:58.339921 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:20:58.339921 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:20:58.339921 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:20:58.339921 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:20:58.339921 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application with Lock( Sep 24 19:20:58.339921 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:20:58.339921 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:20:58.339921 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:20:58.339921 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:20:58.341517 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:20:58.341517 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:20:58.341517 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:20:58.341517 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:20:58.341517 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:20:58.341517 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:20:58.341517 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:20:58.341517 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:20:58.341517 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:20:58.341517 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:20:58.341517 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 24 19:20:58.341517 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Sep 24 19:20:58.345583 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 81/163] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Sep 24 19:20:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:20:58.354997 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2cf065-fa65-4444-a74c-7c70d5305505 None None] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:20:58.504057 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2cf065-fa65-4444-a74c-7c70d5305505 None None] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:20:58.512847 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:20:58.565889 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cf39c3-67da-4632-aa60-2a9f8bfb58d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:20:58.566621 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cf39c3-67da-4632-aa60-2a9f8bfb58d2 None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:58.566893 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cf39c3-67da-4632-aa60-2a9f8bfb58d2 None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:58.567158 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cf39c3-67da-4632-aa60-2a9f8bfb58d2 None admin] PATH_INFO: `/v3/roles` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:58.568022 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cf39c3-67da-4632-aa60-2a9f8bfb58d2 None admin] RBAC: Adding query filter params (name=member) {{(pid=88080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:20:58.568335 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cf39c3-67da-4632-aa60-2a9f8bfb58d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:20:58.569788 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cf39c3-67da-4632-aa60-2a9f8bfb58d2 None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:20:58.583757 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 83/164] 10.222.0.18 () {56 vars in 1101 bytes} [Sat Sep 24 19:20:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:20:58.590087 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33af1def-d510-4cf0-a19d-1f5510736984 None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:20:58.625480 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:20:58.655091 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cf39c3-67da-4632-aa60-2a9f8bfb58d2 None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:20:58.837929 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33af1def-d510-4cf0-a19d-1f5510736984 None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:20:58.907934 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8967014f-9191-4070-a773-24a05b410914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:20:58.908594 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8967014f-9191-4070-a773-24a05b410914 None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:58.908869 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8967014f-9191-4070-a773-24a05b410914 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:58.909138 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8967014f-9191-4070-a773-24a05b410914 None admin] PATH_INFO: `/v3/users/6fe4c395bf344558954904e47a38c49e` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:58.910492 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8967014f-9191-4070-a773-24a05b410914 None admin] RBAC: Authorizing `identity:get_user(user_id=6fe4c395bf344558954904e47a38c49e)` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:20:58.912447 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8967014f-9191-4070-a773-24a05b410914 None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:20:58.916630 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 82/165] 10.222.0.18 () {56 vars in 1177 bytes} [Sat Sep 24 19:20:58 2022] GET /identity/v3/users/6fe4c395bf344558954904e47a38c49e => generated 275 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:20:58.923264 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8967014f-9191-4070-a773-24a05b410914 None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:20:58.955999 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cf39c3-67da-4632-aa60-2a9f8bfb58d2 None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:20:59.031578 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6956b9-2ee8-4d31-8cdf-ce188bcdaffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:20:59.032226 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6956b9-2ee8-4d31-8cdf-ce188bcdaffe None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:59.032501 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6956b9-2ee8-4d31-8cdf-ce188bcdaffe None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:59.032766 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6956b9-2ee8-4d31-8cdf-ce188bcdaffe None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:59.056007 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6956b9-2ee8-4d31-8cdf-ce188bcdaffe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:20:59.061378 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application [None req-3b6956b9-2ee8-4d31-8cdf-ce188bcdaffe None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 24 19:20:59.061378 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:20:59.061378 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:20:59.061378 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:20:59.061378 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:20:59.061378 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:20:59.061378 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:20:59.061378 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:20:59.061378 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:20:59.061378 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:20:59.061378 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:20:59.061378 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:20:59.061378 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:20:59.061378 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:20:59.061378 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:20:59.061378 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:20:59.062338 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:20:59.062338 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:20:59.062338 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:20:59.062338 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:20:59.062338 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:20:59.062338 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:20:59.062338 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:20:59.062338 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:20:59.062338 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:20:59.062338 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:20:59.062338 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:20:59.062338 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application with Lock( Sep 24 19:20:59.062338 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:20:59.062338 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:20:59.062338 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:20:59.062338 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:20:59.063385 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:20:59.063385 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:20:59.063385 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:20:59.063385 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:20:59.063385 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:20:59.063385 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:20:59.063385 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:20:59.063385 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:20:59.063385 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:20:59.063385 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:20:59.063385 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 24 19:20:59.063385 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Sep 24 19:20:59.075680 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 84/166] 10.222.0.18 () {56 vars in 1114 bytes} [Sat Sep 24 19:20:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 417 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 19:20:59.076623 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6956b9-2ee8-4d31-8cdf-ce188bcdaffe None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:20:59.103699 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:20:59.147606 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:20:59.163000 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8967014f-9191-4070-a773-24a05b410914 None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:20:59.255805 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a98c173-e5d9-48c6-9f7e-473030054abf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:20:59.256525 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a98c173-e5d9-48c6-9f7e-473030054abf None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:59.256835 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a98c173-e5d9-48c6-9f7e-473030054abf None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:59.257126 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a98c173-e5d9-48c6-9f7e-473030054abf None admin] PATH_INFO: `/v3/roles/member` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:59.290988 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a98c173-e5d9-48c6-9f7e-473030054abf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:20:59.297017 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application [None req-0a98c173-e5d9-48c6-9f7e-473030054abf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 24 19:20:59.297017 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:20:59.297017 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:20:59.297017 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:20:59.297017 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:20:59.297017 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:20:59.297017 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:20:59.297017 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:20:59.297017 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:20:59.297017 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:20:59.297017 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:20:59.297017 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:20:59.297017 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:20:59.297017 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:20:59.297017 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:20:59.297017 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:20:59.298268 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:20:59.298268 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:20:59.298268 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:20:59.298268 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:20:59.298268 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:20:59.298268 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:20:59.298268 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:20:59.298268 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:20:59.298268 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:20:59.298268 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:20:59.298268 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:20:59.298268 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application with Lock( Sep 24 19:20:59.298268 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:20:59.298268 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:20:59.298268 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:20:59.298268 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:20:59.299914 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:20:59.299914 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:20:59.299914 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:20:59.299914 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:20:59.299914 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:20:59.299914 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:20:59.299914 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:20:59.299914 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:20:59.299914 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:20:59.299914 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:20:59.299914 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 24 19:20:59.299914 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Sep 24 19:20:59.299914 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 83/167] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Sep 24 19:20:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 381 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:20:59.299914 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a98c173-e5d9-48c6-9f7e-473030054abf None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:20:59.364680 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6956b9-2ee8-4d31-8cdf-ce188bcdaffe None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:20:59.491922 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b016e10-1ff5-494c-a9bf-144e0cac8fba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:20:59.492541 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b016e10-1ff5-494c-a9bf-144e0cac8fba None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:59.492857 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b016e10-1ff5-494c-a9bf-144e0cac8fba None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:59.493347 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b016e10-1ff5-494c-a9bf-144e0cac8fba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:59.580488 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a98c173-e5d9-48c6-9f7e-473030054abf None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:20:59.643133 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4147df4-293a-4863-92b7-6dc872b46298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:20:59.643641 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4147df4-293a-4863-92b7-6dc872b46298 None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:59.643919 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4147df4-293a-4863-92b7-6dc872b46298 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:59.644181 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4147df4-293a-4863-92b7-6dc872b46298 None admin] PATH_INFO: `/v3/roles` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:59.644851 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4147df4-293a-4863-92b7-6dc872b46298 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:20:59.645229 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4147df4-293a-4863-92b7-6dc872b46298 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:20:59.646742 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4147df4-293a-4863-92b7-6dc872b46298 None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:20:59.657011 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 84/168] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Sep 24 19:20:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 358 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:20:59.657505 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4147df4-293a-4863-92b7-6dc872b46298 None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:20:59.658707 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b016e10-1ff5-494c-a9bf-144e0cac8fba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:20:59.660525 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b016e10-1ff5-494c-a9bf-144e0cac8fba None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:20:59.662349 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:20:59.736383 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:20:59.781531 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4147df4-293a-4863-92b7-6dc872b46298 None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:20:59.852021 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d166cd8a-24fe-44ec-9407-fe057a3e3e6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:20:59.852668 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d166cd8a-24fe-44ec-9407-fe057a3e3e6d None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:20:59.852985 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d166cd8a-24fe-44ec-9407-fe057a3e3e6d None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:20:59.853173 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d166cd8a-24fe-44ec-9407-fe057a3e3e6d None admin] PATH_INFO: `/v3/roles` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:20:59.853819 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d166cd8a-24fe-44ec-9407-fe057a3e3e6d None admin] RBAC: Adding query filter params (name=member) {{(pid=88081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:20:59.854136 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d166cd8a-24fe-44ec-9407-fe057a3e3e6d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:20:59.855516 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d166cd8a-24fe-44ec-9407-fe057a3e3e6d None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:20:59.869995 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 85/169] 10.222.0.18 () {56 vars in 1101 bytes} [Sat Sep 24 19:20:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:20:59.870861 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d166cd8a-24fe-44ec-9407-fe057a3e3e6d None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:20:59.903430 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 85/170] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Sep 24 19:20:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 827 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 24 19:20:59.904212 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b016e10-1ff5-494c-a9bf-144e0cac8fba None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:20:59.990431 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:00.028076 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d166cd8a-24fe-44ec-9407-fe057a3e3e6d None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:00.075086 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0895e52-35c3-47c9-804d-512b2c531a1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:00.075924 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0895e52-35c3-47c9-804d-512b2c531a1f None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:00.076225 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0895e52-35c3-47c9-804d-512b2c531a1f None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:00.076642 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0895e52-35c3-47c9-804d-512b2c531a1f None admin] PATH_INFO: `/v3/users/6fe4c395bf344558954904e47a38c49e` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:00.078634 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0895e52-35c3-47c9-804d-512b2c531a1f None admin] RBAC: Authorizing `identity:get_user(user_id=6fe4c395bf344558954904e47a38c49e)` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:00.080776 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0895e52-35c3-47c9-804d-512b2c531a1f None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:00.082716 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 86/171] 10.222.0.18 () {56 vars in 1177 bytes} [Sat Sep 24 19:20:59 2022] GET /identity/v3/users/6fe4c395bf344558954904e47a38c49e => generated 275 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:21:00.089570 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0895e52-35c3-47c9-804d-512b2c531a1f None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:00.160872 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b016e10-1ff5-494c-a9bf-144e0cac8fba None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:00.225088 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:00.251163 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723f62a9-3fb2-4c46-85a3-26fcb87423b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:00.251939 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723f62a9-3fb2-4c46-85a3-26fcb87423b4 None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:00.252320 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723f62a9-3fb2-4c46-85a3-26fcb87423b4 None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:00.252611 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723f62a9-3fb2-4c46-85a3-26fcb87423b4 None admin] PATH_INFO: `/v3/users/6fe4c395bf344558954904e47a38c49e` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:00.254040 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723f62a9-3fb2-4c46-85a3-26fcb87423b4 None admin] RBAC: Authorizing `identity:get_user(user_id=6fe4c395bf344558954904e47a38c49e)` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:00.256053 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723f62a9-3fb2-4c46-85a3-26fcb87423b4 None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:00.257752 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 86/172] 10.222.0.18 () {56 vars in 1177 bytes} [Sat Sep 24 19:20:59 2022] GET /identity/v3/users/6fe4c395bf344558954904e47a38c49e => generated 275 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:21:00.258607 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723f62a9-3fb2-4c46-85a3-26fcb87423b4 None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:00.310317 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0895e52-35c3-47c9-804d-512b2c531a1f None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:00.355470 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c26d8c5-6c07-44b4-8d4b-f6450ef10801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:00.356126 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c26d8c5-6c07-44b4-8d4b-f6450ef10801 None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:00.356572 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c26d8c5-6c07-44b4-8d4b-f6450ef10801 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:00.356946 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c26d8c5-6c07-44b4-8d4b-f6450ef10801 None admin] PATH_INFO: `/v3/projects/b7aa834667ed445eba7561ef6fd2d3c6` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:00.359534 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c26d8c5-6c07-44b4-8d4b-f6450ef10801 None admin] RBAC: Authorizing `identity:get_project(project_id=b7aa834667ed445eba7561ef6fd2d3c6)` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:00.364591 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c26d8c5-6c07-44b4-8d4b-f6450ef10801 None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:00.365498 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 87/173] 10.222.0.18 () {56 vars in 1186 bytes} [Sat Sep 24 19:21:00 2022] GET /identity/v3/projects/b7aa834667ed445eba7561ef6fd2d3c6 => generated 298 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:21:00.366961 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c26d8c5-6c07-44b4-8d4b-f6450ef10801 None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:00.378323 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:00.490138 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723f62a9-3fb2-4c46-85a3-26fcb87423b4 None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:00.525013 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c26d8c5-6c07-44b4-8d4b-f6450ef10801 None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:00.541807 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287b2dc1-ab85-4f38-8572-508d066729c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:00.542517 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287b2dc1-ab85-4f38-8572-508d066729c3 None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:00.542795 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287b2dc1-ab85-4f38-8572-508d066729c3 None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:00.543101 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287b2dc1-ab85-4f38-8572-508d066729c3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:00.568916 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f75762c-b0ff-4d47-af2c-56d49b8c993f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:00.569621 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f75762c-b0ff-4d47-af2c-56d49b8c993f None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:00.569787 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f75762c-b0ff-4d47-af2c-56d49b8c993f None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:00.570113 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f75762c-b0ff-4d47-af2c-56d49b8c993f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:00.622691 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:00.632917 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287b2dc1-ab85-4f38-8572-508d066729c3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:00.634650 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287b2dc1-ab85-4f38-8572-508d066729c3 None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:00.657489 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f75762c-b0ff-4d47-af2c-56d49b8c993f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:00.665224 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f75762c-b0ff-4d47-af2c-56d49b8c993f None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:00.667438 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:00.768081 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 87/174] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Sep 24 19:21:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 510 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 24 19:21:00.769707 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44941af8-95b1-440e-8eb3-28af89265ce9 None None] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:00.775841 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44941af8-95b1-440e-8eb3-28af89265ce9 None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:00.776147 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44941af8-95b1-440e-8eb3-28af89265ce9 None None] PATH_INFO: `/` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:00.777594 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 88/175] 10.222.0.18 () {54 vars in 927 bytes} [Sat Sep 24 19:21:00 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:21:00.778400 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44941af8-95b1-440e-8eb3-28af89265ce9 None None] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:00.804275 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 88/176] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Sep 24 19:21:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 24 19:21:00.806082 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029135d0-7ede-4caf-990b-e3c60af16597 None None] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:00.806392 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029135d0-7ede-4caf-990b-e3c60af16597 None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:00.806684 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029135d0-7ede-4caf-990b-e3c60af16597 None None] PATH_INFO: `/` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:00.812414 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 89/177] 10.222.0.18 () {54 vars in 927 bytes} [Sat Sep 24 19:21:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:21:00.812414 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a638bd-6993-4b0c-b0f5-04e8aa1883d8 None None] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:00.812414 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a638bd-6993-4b0c-b0f5-04e8aa1883d8 None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:00.812414 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a638bd-6993-4b0c-b0f5-04e8aa1883d8 None None] PATH_INFO: `/` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:00.812414 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 90/178] 10.222.0.18 () {54 vars in 927 bytes} [Sat Sep 24 19:21:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:21:00.816801 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a638bd-6993-4b0c-b0f5-04e8aa1883d8 None None] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:00.916536 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:00.929198 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44941af8-95b1-440e-8eb3-28af89265ce9 None None] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:00.958980 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a638bd-6993-4b0c-b0f5-04e8aa1883d8 None None] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:00.960950 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:00.975899 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a821ed0f-8c0d-4f94-9970-5d250409b495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:00.976655 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a821ed0f-8c0d-4f94-9970-5d250409b495 None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:00.977026 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a821ed0f-8c0d-4f94-9970-5d250409b495 None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:00.977323 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a821ed0f-8c0d-4f94-9970-5d250409b495 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:00.978171 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a821ed0f-8c0d-4f94-9970-5d250409b495 None admin] RBAC: Adding query filter params (role.id=3a42524fc57c4487a34c5c05234413a7, scope.project.id=b7aa834667ed445eba7561ef6fd2d3c6, user.id=6fe4c395bf344558954904e47a38c49e) {{(pid=88080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:21:00.978486 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a821ed0f-8c0d-4f94-9970-5d250409b495 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:00.980118 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a821ed0f-8c0d-4f94-9970-5d250409b495 None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:00.988525 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 89/179] 10.222.0.18 () {56 vars in 1374 bytes} [Sat Sep 24 19:21:00 2022] GET /identity/v3/role_assignments?user.id=6fe4c395bf344558954904e47a38c49e&scope.project.id=b7aa834667ed445eba7561ef6fd2d3c6&role.id=3a42524fc57c4487a34c5c05234413a7 => generated 608 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:21:00.990473 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9acf78-a806-4d1d-a06e-ff90deaf060b None None] REQUEST_METHOD: `POST` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:00.990758 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9acf78-a806-4d1d-a06e-ff90deaf060b None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:00.991134 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9acf78-a806-4d1d-a06e-ff90deaf060b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:01.001929 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaf1eae-9d23-4064-b15c-bb0f43852f73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:01.002696 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaf1eae-9d23-4064-b15c-bb0f43852f73 None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:01.003343 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaf1eae-9d23-4064-b15c-bb0f43852f73 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:01.003739 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaf1eae-9d23-4064-b15c-bb0f43852f73 None admin] PATH_INFO: `/v3/projects/b7aa834667ed445eba7561ef6fd2d3c6` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:01.005329 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeaf1eae-9d23-4064-b15c-bb0f43852f73 None admin] RBAC: Authorizing `identity:get_project(project_id=b7aa834667ed445eba7561ef6fd2d3c6)` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:01.007031 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeaf1eae-9d23-4064-b15c-bb0f43852f73 None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:01.014183 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 91/180] 10.222.0.18 () {56 vars in 1186 bytes} [Sat Sep 24 19:21:00 2022] GET /identity/v3/projects/b7aa834667ed445eba7561ef6fd2d3c6 => generated 298 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:21:01.014183 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaf1eae-9d23-4064-b15c-bb0f43852f73 None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:01.016008 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.auth.core [None req-3f9acf78-a806-4d1d-a06e-ff90deaf060b None None] MFA Rules not processed for user `3dbbb9909cec43ff99c1c3682f016ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=88080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:21:01.017777 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.fernet_utils [None req-3f9acf78-a806-4d1d-a06e-ff90deaf060b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:21:01.132246 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 90/181] 10.222.0.18 () {58 vars in 1024 bytes} [Sat Sep 24 19:21:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:21:01.142177 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c12c23-cf30-4ae1-bf83-eb9baa1ffd51 None None] REQUEST_METHOD: `POST` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:01.142177 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c12c23-cf30-4ae1-bf83-eb9baa1ffd51 None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:01.142177 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c12c23-cf30-4ae1-bf83-eb9baa1ffd51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:01.150687 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaf1eae-9d23-4064-b15c-bb0f43852f73 None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:01.166387 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.auth.core [None req-18c12c23-cf30-4ae1-bf83-eb9baa1ffd51 None None] MFA Rules not processed for user `3dbbb9909cec43ff99c1c3682f016ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=88080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:21:01.167765 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.fernet_utils [None req-18c12c23-cf30-4ae1-bf83-eb9baa1ffd51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:21:01.233691 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cd2c9a-9fa8-4e7f-b068-cbf7a25b9c1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:01.234812 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cd2c9a-9fa8-4e7f-b068-cbf7a25b9c1c None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:01.235295 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cd2c9a-9fa8-4e7f-b068-cbf7a25b9c1c None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:01.235789 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cd2c9a-9fa8-4e7f-b068-cbf7a25b9c1c None admin] PATH_INFO: `/v3/projects/a7b33840413d4f388f2510aecd344eec` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:01.238968 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cd2c9a-9fa8-4e7f-b068-cbf7a25b9c1c None admin] RBAC: Authorizing `identity:get_project(project_id=a7b33840413d4f388f2510aecd344eec)` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:01.242712 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cd2c9a-9fa8-4e7f-b068-cbf7a25b9c1c None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:01.247772 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 92/182] 10.222.0.18 () {56 vars in 1186 bytes} [Sat Sep 24 19:21:01 2022] GET /identity/v3/projects/a7b33840413d4f388f2510aecd344eec => generated 312 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:21:01.251247 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7368df-62b4-4328-85e7-53e52620cf7b None None] REQUEST_METHOD: `POST` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:01.252297 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7368df-62b4-4328-85e7-53e52620cf7b None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:01.252431 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7368df-62b4-4328-85e7-53e52620cf7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:01.276895 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.auth.core [None req-cb7368df-62b4-4328-85e7-53e52620cf7b None None] MFA Rules not processed for user `3dbbb9909cec43ff99c1c3682f016ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=88081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:21:01.278213 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.fernet_utils [None req-cb7368df-62b4-4328-85e7-53e52620cf7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:21:01.284102 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 91/183] 10.222.0.18 () {58 vars in 1024 bytes} [Sat Sep 24 19:21:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:21:01.287012 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73426fb-56d3-41d3-bd5e-b52a3fa193f5 None None] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:01.287497 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73426fb-56d3-41d3-bd5e-b52a3fa193f5 None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:01.287847 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73426fb-56d3-41d3-bd5e-b52a3fa193f5 None None] PATH_INFO: `/` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:01.289480 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 92/184] 10.222.0.18 () {54 vars in 927 bytes} [Sat Sep 24 19:21:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:21:01.295137 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73426fb-56d3-41d3-bd5e-b52a3fa193f5 None None] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:01.321550 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:01.349506 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:01.406187 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 93/185] 10.222.0.18 () {58 vars in 1024 bytes} [Sat Sep 24 19:21:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:21:01.407368 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7368df-62b4-4328-85e7-53e52620cf7b None None] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:01.473821 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73426fb-56d3-41d3-bd5e-b52a3fa193f5 None None] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:01.538138 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0acc7f6-896c-45dc-bd6c-a023557acab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:01.538679 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0acc7f6-896c-45dc-bd6c-a023557acab6 None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:01.539223 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0acc7f6-896c-45dc-bd6c-a023557acab6 None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:01.540171 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0acc7f6-896c-45dc-bd6c-a023557acab6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:01.541245 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0acc7f6-896c-45dc-bd6c-a023557acab6 None admin] RBAC: Adding query filter params (role.id=a24280fb630f4c17865458d833144b17, scope.project.id=b7aa834667ed445eba7561ef6fd2d3c6, user.id=6fe4c395bf344558954904e47a38c49e) {{(pid=88080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:21:01.541600 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0acc7f6-896c-45dc-bd6c-a023557acab6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:01.543271 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0acc7f6-896c-45dc-bd6c-a023557acab6 None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:01.551461 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 93/186] 10.222.0.18 () {56 vars in 1374 bytes} [Sat Sep 24 19:21:01 2022] GET /identity/v3/role_assignments?user.id=6fe4c395bf344558954904e47a38c49e&scope.project.id=b7aa834667ed445eba7561ef6fd2d3c6&role.id=a24280fb630f4c17865458d833144b17 => generated 608 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:21:01.553234 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d732008-21f4-4164-b876-d686942cbcd2 None None] REQUEST_METHOD: `POST` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:01.553526 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d732008-21f4-4164-b876-d686942cbcd2 None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:01.553801 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d732008-21f4-4164-b876-d686942cbcd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:01.558732 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7368df-62b4-4328-85e7-53e52620cf7b None None] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:01.580024 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.auth.core [None req-6d732008-21f4-4164-b876-d686942cbcd2 None None] MFA Rules not processed for user `3dbbb9909cec43ff99c1c3682f016ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=88080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:21:01.581263 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.fernet_utils [None req-6d732008-21f4-4164-b876-d686942cbcd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:21:01.649037 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b4ecf3-19c9-4279-bc35-363c2edeb96c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:01.650884 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b4ecf3-19c9-4279-bc35-363c2edeb96c None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:01.651408 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b4ecf3-19c9-4279-bc35-363c2edeb96c None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:01.651974 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b4ecf3-19c9-4279-bc35-363c2edeb96c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:01.652959 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b4ecf3-19c9-4279-bc35-363c2edeb96c None admin] RBAC: Adding query filter params (role.id=3a42524fc57c4487a34c5c05234413a7, scope.project.id=a7b33840413d4f388f2510aecd344eec, user.id=6fe4c395bf344558954904e47a38c49e) {{(pid=88081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:21:01.653544 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b4ecf3-19c9-4279-bc35-363c2edeb96c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:01.655462 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b4ecf3-19c9-4279-bc35-363c2edeb96c None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:01.664789 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 94/187] 10.222.0.18 () {56 vars in 1374 bytes} [Sat Sep 24 19:21:01 2022] GET /identity/v3/role_assignments?user.id=6fe4c395bf344558954904e47a38c49e&scope.project.id=a7b33840413d4f388f2510aecd344eec&role.id=3a42524fc57c4487a34c5c05234413a7 => generated 608 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:21:01.666209 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b4ecf3-19c9-4279-bc35-363c2edeb96c None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:01.677901 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 94/188] 10.222.0.18 () {58 vars in 1024 bytes} [Sat Sep 24 19:21:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:21:01.677901 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d732008-21f4-4164-b876-d686942cbcd2 None None] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:01.692179 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:01.755524 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:01.866799 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b4ecf3-19c9-4279-bc35-363c2edeb96c None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:01.883054 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d732008-21f4-4164-b876-d686942cbcd2 None None] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:01.914737 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee24963c-6365-4869-9a62-4f0ffd6357fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:01.915812 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee24963c-6365-4869-9a62-4f0ffd6357fc None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:01.916301 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee24963c-6365-4869-9a62-4f0ffd6357fc None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:01.916818 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee24963c-6365-4869-9a62-4f0ffd6357fc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:01.935722 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee24963c-6365-4869-9a62-4f0ffd6357fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:21:01.944625 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application [None req-ee24963c-6365-4869-9a62-4f0ffd6357fc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 19:21:01.944625 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:21:01.944625 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:21:01.944625 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:21:01.944625 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:21:01.944625 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:21:01.944625 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:21:01.944625 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:21:01.944625 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:21:01.944625 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:21:01.944625 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:21:01.944625 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:21:01.944625 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:21:01.944625 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:21:01.944625 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:21:01.944625 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:21:01.945583 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:21:01.945583 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:21:01.945583 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:21:01.945583 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:21:01.945583 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:21:01.945583 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:21:01.945583 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:21:01.945583 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:21:01.945583 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:21:01.945583 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:21:01.945583 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:21:01.945583 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application with Lock( Sep 24 19:21:01.945583 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:21:01.945583 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:21:01.945583 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:21:01.945583 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:21:01.947110 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:21:01.947110 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:21:01.947110 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:21:01.947110 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:21:01.947110 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:21:01.947110 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:21:01.947110 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:21:01.947110 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:21:01.947110 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:21:01.947110 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:21:01.947110 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 19:21:01.947110 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Sep 24 19:21:01.947110 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 95/189] 10.222.0.18 () {56 vars in 1096 bytes} [Sat Sep 24 19:21:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:21:01.949266 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dc2eff-2f2b-4383-82eb-d3cc2a045772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:01.950273 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dc2eff-2f2b-4383-82eb-d3cc2a045772 None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:01.950804 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dc2eff-2f2b-4383-82eb-d3cc2a045772 None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:01.950906 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee24963c-6365-4869-9a62-4f0ffd6357fc None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:01.951412 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dc2eff-2f2b-4383-82eb-d3cc2a045772 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:01.967532 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dc2eff-2f2b-4383-82eb-d3cc2a045772 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:21:01.973133 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application [None req-04dc2eff-2f2b-4383-82eb-d3cc2a045772 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 24 19:21:01.973133 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:21:01.973133 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:21:01.973133 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:21:01.973133 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:21:01.973133 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:21:01.973133 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:21:01.973133 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:21:01.973133 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:21:01.973133 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:21:01.973133 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:21:01.973133 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:21:01.973133 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:21:01.973133 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:21:01.973133 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:21:01.973133 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:21:01.974707 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:21:01.974707 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:21:01.974707 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:21:01.974707 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:21:01.974707 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:21:01.974707 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:21:01.974707 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:21:01.974707 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:21:01.974707 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:21:01.974707 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:21:01.974707 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:21:01.974707 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application with Lock( Sep 24 19:21:01.974707 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:21:01.974707 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:21:01.974707 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:21:01.974707 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:21:01.975744 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:21:01.975744 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:21:01.975744 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:21:01.975744 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:21:01.975744 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:21:01.975744 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:21:01.975744 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:21:01.975744 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:21:01.975744 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:21:01.975744 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:21:01.975744 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 24 19:21:01.975744 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Sep 24 19:21:01.975744 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 95/190] 10.222.0.18 () {56 vars in 1114 bytes} [Sat Sep 24 19:21:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:21:01.975744 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dc2eff-2f2b-4383-82eb-d3cc2a045772 None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:02.096026 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:02.102476 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:02.107593 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee24963c-6365-4869-9a62-4f0ffd6357fc None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:02.147639 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dc2eff-2f2b-4383-82eb-d3cc2a045772 None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:02.150564 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ca4f5f-8b59-466b-a39f-9992f523ac41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:02.151218 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ca4f5f-8b59-466b-a39f-9992f523ac41 None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:02.151496 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ca4f5f-8b59-466b-a39f-9992f523ac41 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:02.151763 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ca4f5f-8b59-466b-a39f-9992f523ac41 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:02.152993 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ca4f5f-8b59-466b-a39f-9992f523ac41 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:02.154538 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ca4f5f-8b59-466b-a39f-9992f523ac41 None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:02.156219 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 96/191] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Sep 24 19:21:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:21:02.157057 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ca4f5f-8b59-466b-a39f-9992f523ac41 None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:02.187166 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3df8bb-b21a-4b53-b33e-09a7efe3a314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:02.187855 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3df8bb-b21a-4b53-b33e-09a7efe3a314 None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:02.188130 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3df8bb-b21a-4b53-b33e-09a7efe3a314 None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:02.188398 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3df8bb-b21a-4b53-b33e-09a7efe3a314 None admin] PATH_INFO: `/v3/roles` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:02.189076 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3df8bb-b21a-4b53-b33e-09a7efe3a314 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:21:02.189372 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3df8bb-b21a-4b53-b33e-09a7efe3a314 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:02.190860 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3df8bb-b21a-4b53-b33e-09a7efe3a314 None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:02.200192 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 96/192] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Sep 24 19:21:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:21:02.202834 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3df8bb-b21a-4b53-b33e-09a7efe3a314 None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:02.268728 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ca4f5f-8b59-466b-a39f-9992f523ac41 None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:02.310017 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3df8bb-b21a-4b53-b33e-09a7efe3a314 None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:02.314268 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66a6529-6c16-482e-bfdf-8447611d0680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:02.314876 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66a6529-6c16-482e-bfdf-8447611d0680 None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:02.315156 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66a6529-6c16-482e-bfdf-8447611d0680 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:02.315419 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66a6529-6c16-482e-bfdf-8447611d0680 None admin] PATH_INFO: `/v3/roles` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:02.316076 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66a6529-6c16-482e-bfdf-8447611d0680 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:21:02.316369 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66a6529-6c16-482e-bfdf-8447611d0680 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:02.318473 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66a6529-6c16-482e-bfdf-8447611d0680 None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:02.326739 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 97/193] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Sep 24 19:21:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:21:02.327530 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66a6529-6c16-482e-bfdf-8447611d0680 None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:02.346688 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7f22af-e000-4319-9fb3-78caf75bccd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:02.347317 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7f22af-e000-4319-9fb3-78caf75bccd4 None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:02.347592 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7f22af-e000-4319-9fb3-78caf75bccd4 None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:02.347860 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7f22af-e000-4319-9fb3-78caf75bccd4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:02.350923 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:02.355804 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:02.362013 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7f22af-e000-4319-9fb3-78caf75bccd4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:21:02.368625 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application [None req-cf7f22af-e000-4319-9fb3-78caf75bccd4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 24 19:21:02.368625 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:21:02.368625 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:21:02.368625 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:21:02.368625 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:21:02.368625 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:21:02.368625 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:21:02.368625 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:21:02.368625 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:21:02.368625 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:21:02.368625 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:21:02.368625 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:21:02.368625 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:21:02.368625 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:21:02.368625 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:21:02.368625 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:21:02.369726 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:21:02.369726 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:21:02.369726 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:21:02.369726 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:21:02.369726 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:21:02.369726 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:21:02.369726 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:21:02.369726 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:21:02.369726 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:21:02.369726 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:21:02.369726 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:21:02.369726 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application with Lock( Sep 24 19:21:02.369726 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:21:02.369726 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:21:02.369726 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:21:02.369726 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:21:02.370774 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:21:02.370774 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:21:02.370774 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:21:02.370774 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:21:02.370774 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:21:02.370774 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:21:02.370774 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:21:02.370774 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:21:02.370774 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:21:02.370774 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:21:02.370774 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 24 19:21:02.370774 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Sep 24 19:21:02.370774 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 97/194] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Sep 24 19:21:02 2022] GET /identity/v3/roles/reader => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:21:02.370774 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7f22af-e000-4319-9fb3-78caf75bccd4 None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:02.437181 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66a6529-6c16-482e-bfdf-8447611d0680 None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:02.471152 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aebe7e0-8c8b-4920-bb50-3c22c825f6bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:02.471756 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aebe7e0-8c8b-4920-bb50-3c22c825f6bb None admin] REQUEST_METHOD: `POST` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:02.472031 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aebe7e0-8c8b-4920-bb50-3c22c825f6bb None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:02.472295 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aebe7e0-8c8b-4920-bb50-3c22c825f6bb None admin] PATH_INFO: `/v3/users` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:02.472933 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aebe7e0-8c8b-4920-bb50-3c22c825f6bb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:02.474891 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aebe7e0-8c8b-4920-bb50-3c22c825f6bb None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:02.476483 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7f22af-e000-4319-9fb3-78caf75bccd4 None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:02.496779 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 98/195] 10.222.0.18 () {60 vars in 1132 bytes} [Sat Sep 24 19:21:02 2022] POST /identity/v3/users => generated 297 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:21:02.497687 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aebe7e0-8c8b-4920-bb50-3c22c825f6bb None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:02.514272 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f535b02-05b1-475c-88ca-3591ed812828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:02.515191 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f535b02-05b1-475c-88ca-3591ed812828 None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:02.515463 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f535b02-05b1-475c-88ca-3591ed812828 None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:02.515728 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f535b02-05b1-475c-88ca-3591ed812828 None admin] PATH_INFO: `/v3/users/e15d6166e0bc4bf585c618e905a89a84` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:02.531381 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f535b02-05b1-475c-88ca-3591ed812828 None admin] RBAC: Authorizing `identity:get_user(user_id=e15d6166e0bc4bf585c618e905a89a84)` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:02.532898 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f535b02-05b1-475c-88ca-3591ed812828 None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:02.534972 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 98/196] 10.222.0.18 () {56 vars in 1177 bytes} [Sat Sep 24 19:21:02 2022] GET /identity/v3/users/e15d6166e0bc4bf585c618e905a89a84 => generated 283 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:21:02.535600 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f535b02-05b1-475c-88ca-3591ed812828 None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:02.605184 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:02.626475 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:02.655734 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aebe7e0-8c8b-4920-bb50-3c22c825f6bb None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:02.669678 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f535b02-05b1-475c-88ca-3591ed812828 None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:02.695950 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d2bc51-e03a-4ee5-ad15-4c13d82ad1ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:02.696600 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d2bc51-e03a-4ee5-ad15-4c13d82ad1ba None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:02.696881 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d2bc51-e03a-4ee5-ad15-4c13d82ad1ba None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:02.697150 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d2bc51-e03a-4ee5-ad15-4c13d82ad1ba None admin] PATH_INFO: `/v3/users/e15d6166e0bc4bf585c618e905a89a84` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:02.698412 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d2bc51-e03a-4ee5-ad15-4c13d82ad1ba None admin] RBAC: Authorizing `identity:get_user(user_id=e15d6166e0bc4bf585c618e905a89a84)` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:02.699893 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d2bc51-e03a-4ee5-ad15-4c13d82ad1ba None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:02.701704 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 99/197] 10.222.0.18 () {56 vars in 1177 bytes} [Sat Sep 24 19:21:02 2022] GET /identity/v3/users/e15d6166e0bc4bf585c618e905a89a84 => generated 283 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:21:02.702449 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d2bc51-e03a-4ee5-ad15-4c13d82ad1ba None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:02.715362 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607c02d3-9ff5-4b0b-9456-62cd241aff98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:02.716885 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607c02d3-9ff5-4b0b-9456-62cd241aff98 None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:02.716885 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607c02d3-9ff5-4b0b-9456-62cd241aff98 None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:02.716885 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607c02d3-9ff5-4b0b-9456-62cd241aff98 None admin] PATH_INFO: `/v3/roles` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:02.717189 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607c02d3-9ff5-4b0b-9456-62cd241aff98 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:21:02.717481 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607c02d3-9ff5-4b0b-9456-62cd241aff98 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:02.719532 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607c02d3-9ff5-4b0b-9456-62cd241aff98 None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:02.730731 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 99/198] 10.222.0.18 () {56 vars in 1101 bytes} [Sat Sep 24 19:21:02 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:21:02.730731 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607c02d3-9ff5-4b0b-9456-62cd241aff98 None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:02.847784 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d2bc51-e03a-4ee5-ad15-4c13d82ad1ba None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:02.874799 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607c02d3-9ff5-4b0b-9456-62cd241aff98 None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:02.893081 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:02.902954 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b149a35f-cff5-4ccf-bc49-4e02ddcd4378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:02.903582 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b149a35f-cff5-4ccf-bc49-4e02ddcd4378 None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:02.903861 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b149a35f-cff5-4ccf-bc49-4e02ddcd4378 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:02.904148 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b149a35f-cff5-4ccf-bc49-4e02ddcd4378 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:02.921901 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761bad96-c424-401b-8aae-d5dc524080ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:02.922264 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761bad96-c424-401b-8aae-d5dc524080ef None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:02.922537 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761bad96-c424-401b-8aae-d5dc524080ef None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:02.922797 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761bad96-c424-401b-8aae-d5dc524080ef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:02.926075 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:03.001320 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b149a35f-cff5-4ccf-bc49-4e02ddcd4378 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:03.002916 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b149a35f-cff5-4ccf-bc49-4e02ddcd4378 None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:03.031008 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761bad96-c424-401b-8aae-d5dc524080ef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:03.032836 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761bad96-c424-401b-8aae-d5dc524080ef None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:03.118472 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 100/199] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Sep 24 19:21:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 24 19:21:03.119349 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b149a35f-cff5-4ccf-bc49-4e02ddcd4378 None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:03.144044 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 100/200] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Sep 24 19:21:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 24 19:21:03.144901 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761bad96-c424-401b-8aae-d5dc524080ef None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:03.161954 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:03.184782 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:03.268391 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b149a35f-cff5-4ccf-bc49-4e02ddcd4378 None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:03.278572 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761bad96-c424-401b-8aae-d5dc524080ef None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:03.316854 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57434b5d-8c58-4169-b61f-bcb577404cc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:03.318040 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57434b5d-8c58-4169-b61f-bcb577404cc6 None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:03.318318 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57434b5d-8c58-4169-b61f-bcb577404cc6 None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:03.318764 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57434b5d-8c58-4169-b61f-bcb577404cc6 None admin] PATH_INFO: `/v3/projects/b86798f4dc4d4dd79428558b3d00ae1a` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:03.319809 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57434b5d-8c58-4169-b61f-bcb577404cc6 None admin] RBAC: Authorizing `identity:get_project(project_id=b86798f4dc4d4dd79428558b3d00ae1a)` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:03.321281 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57434b5d-8c58-4169-b61f-bcb577404cc6 None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:03.323191 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 101/201] 10.222.0.18 () {56 vars in 1186 bytes} [Sat Sep 24 19:21:03 2022] GET /identity/v3/projects/b86798f4dc4d4dd79428558b3d00ae1a => generated 302 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:21:03.323966 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57434b5d-8c58-4169-b61f-bcb577404cc6 None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:03.324399 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fb2ded-8ad6-4ba3-b708-626d7c938faa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:03.325197 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fb2ded-8ad6-4ba3-b708-626d7c938faa None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:03.325621 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fb2ded-8ad6-4ba3-b708-626d7c938faa None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:03.326083 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fb2ded-8ad6-4ba3-b708-626d7c938faa None admin] PATH_INFO: `/v3/users/d5e4d93077134f6193a6cf0d9b2cc1f8` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:03.328874 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fb2ded-8ad6-4ba3-b708-626d7c938faa None admin] RBAC: Authorizing `identity:get_user(user_id=d5e4d93077134f6193a6cf0d9b2cc1f8)` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:03.330654 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fb2ded-8ad6-4ba3-b708-626d7c938faa None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:03.334281 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 101/202] 10.222.0.18 () {56 vars in 1177 bytes} [Sat Sep 24 19:21:03 2022] GET /identity/v3/users/d5e4d93077134f6193a6cf0d9b2cc1f8 => generated 289 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:21:03.335111 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fb2ded-8ad6-4ba3-b708-626d7c938faa None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:03.445997 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:03.473022 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57434b5d-8c58-4169-b61f-bcb577404cc6 None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:03.474594 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fb2ded-8ad6-4ba3-b708-626d7c938faa None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:03.494432 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:03.518288 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33b58f3-0dfb-4963-8e4c-0dcc00b16311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:03.519073 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513dcb07-49df-4a84-9d74-225d44ed4406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:03.519632 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513dcb07-49df-4a84-9d74-225d44ed4406 None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:03.519903 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513dcb07-49df-4a84-9d74-225d44ed4406 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:03.520101 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33b58f3-0dfb-4963-8e4c-0dcc00b16311 None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:03.520729 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513dcb07-49df-4a84-9d74-225d44ed4406 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:03.521183 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33b58f3-0dfb-4963-8e4c-0dcc00b16311 None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:03.521417 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513dcb07-49df-4a84-9d74-225d44ed4406 None admin] RBAC: Adding query filter params (role.id=4c7d0dafc19b4b0a9821be6ec0da0a8f, scope.project.id=b86798f4dc4d4dd79428558b3d00ae1a, user.id=e15d6166e0bc4bf585c618e905a89a84) {{(pid=88081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:21:03.521718 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513dcb07-49df-4a84-9d74-225d44ed4406 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:03.522079 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33b58f3-0dfb-4963-8e4c-0dcc00b16311 None admin] PATH_INFO: `/v3/projects/b86798f4dc4d4dd79428558b3d00ae1a` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:03.523343 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513dcb07-49df-4a84-9d74-225d44ed4406 None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:03.523692 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33b58f3-0dfb-4963-8e4c-0dcc00b16311 None admin] RBAC: Authorizing `identity:get_project(project_id=b86798f4dc4d4dd79428558b3d00ae1a)` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:03.525636 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33b58f3-0dfb-4963-8e4c-0dcc00b16311 None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:03.533351 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 102/203] 10.222.0.18 () {56 vars in 1374 bytes} [Sat Sep 24 19:21:03 2022] GET /identity/v3/role_assignments?user.id=e15d6166e0bc4bf585c618e905a89a84&scope.project.id=b86798f4dc4d4dd79428558b3d00ae1a&role.id=4c7d0dafc19b4b0a9821be6ec0da0a8f => generated 259 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:21:03.533351 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513dcb07-49df-4a84-9d74-225d44ed4406 None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:03.534282 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 102/204] 10.222.0.18 () {56 vars in 1186 bytes} [Sat Sep 24 19:21:03 2022] GET /identity/v3/projects/b86798f4dc4d4dd79428558b3d00ae1a => generated 302 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:21:03.536949 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33b58f3-0dfb-4963-8e4c-0dcc00b16311 None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:03.781262 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33b58f3-0dfb-4963-8e4c-0dcc00b16311 None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:03.782667 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513dcb07-49df-4a84-9d74-225d44ed4406 None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:03.856467 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8daa74-997b-45f7-8c8d-d3f6bc125e50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:03.857098 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8daa74-997b-45f7-8c8d-d3f6bc125e50 None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:03.857372 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8daa74-997b-45f7-8c8d-d3f6bc125e50 None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:03.857638 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8daa74-997b-45f7-8c8d-d3f6bc125e50 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:03.858437 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8daa74-997b-45f7-8c8d-d3f6bc125e50 None admin] RBAC: Adding query filter params (role.id=a24280fb630f4c17865458d833144b17, scope.project.id=b86798f4dc4d4dd79428558b3d00ae1a, user.id=e15d6166e0bc4bf585c618e905a89a84) {{(pid=88080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:21:03.859277 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8daa74-997b-45f7-8c8d-d3f6bc125e50 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:03.861408 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8daa74-997b-45f7-8c8d-d3f6bc125e50 None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:03.866510 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6492990b-afa4-48f2-b469-7b1978856761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:03.867258 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6492990b-afa4-48f2-b469-7b1978856761 None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:03.867536 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6492990b-afa4-48f2-b469-7b1978856761 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:03.868061 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6492990b-afa4-48f2-b469-7b1978856761 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:03.884543 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 103/205] 10.222.0.18 () {56 vars in 1374 bytes} [Sat Sep 24 19:21:03 2022] GET /identity/v3/role_assignments?user.id=e15d6166e0bc4bf585c618e905a89a84&scope.project.id=b86798f4dc4d4dd79428558b3d00ae1a&role.id=a24280fb630f4c17865458d833144b17 => generated 259 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:21:03.935292 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:03.963499 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6492990b-afa4-48f2-b469-7b1978856761 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:03.965195 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6492990b-afa4-48f2-b469-7b1978856761 None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:04.095149 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 103/206] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Sep 24 19:21:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 565 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 24 19:21:04.102090 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8daa74-997b-45f7-8c8d-d3f6bc125e50 None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:04.122257 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:04.257954 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8daa74-997b-45f7-8c8d-d3f6bc125e50 None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:04.314601 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7b16ff-82ce-4049-a542-d09d852cd212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:04.315597 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7b16ff-82ce-4049-a542-d09d852cd212 None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:04.316077 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7b16ff-82ce-4049-a542-d09d852cd212 None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:04.316577 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7b16ff-82ce-4049-a542-d09d852cd212 None admin] PATH_INFO: `/v3/projects/b7aa834667ed445eba7561ef6fd2d3c6` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:04.318562 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7b16ff-82ce-4049-a542-d09d852cd212 None admin] RBAC: Authorizing `identity:get_project(project_id=b7aa834667ed445eba7561ef6fd2d3c6)` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:04.320230 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7b16ff-82ce-4049-a542-d09d852cd212 None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:04.322122 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 104/207] 10.222.0.18 () {56 vars in 1186 bytes} [Sat Sep 24 19:21:04 2022] GET /identity/v3/projects/b7aa834667ed445eba7561ef6fd2d3c6 => generated 298 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:21:04.330416 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6492990b-afa4-48f2-b469-7b1978856761 None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:04.455878 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:04.490464 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6492990b-afa4-48f2-b469-7b1978856761 None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:04.545631 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a08b80c-d1bc-4931-bfda-2c033e12b940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:04.546285 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a08b80c-d1bc-4931-bfda-2c033e12b940 None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:04.546565 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a08b80c-d1bc-4931-bfda-2c033e12b940 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:04.546838 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a08b80c-d1bc-4931-bfda-2c033e12b940 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:04.547687 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a08b80c-d1bc-4931-bfda-2c033e12b940 None admin] RBAC: Adding query filter params (role.id=f072ea6ff7ca4dbf90174c318d19acf1, scope.project.id=b7aa834667ed445eba7561ef6fd2d3c6, user.id=d5e4d93077134f6193a6cf0d9b2cc1f8) {{(pid=88081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:21:04.548092 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a08b80c-d1bc-4931-bfda-2c033e12b940 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:04.549679 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a08b80c-d1bc-4931-bfda-2c033e12b940 None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:04.557892 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 104/208] 10.222.0.18 () {56 vars in 1374 bytes} [Sat Sep 24 19:21:04 2022] GET /identity/v3/role_assignments?user.id=d5e4d93077134f6193a6cf0d9b2cc1f8&scope.project.id=b7aa834667ed445eba7561ef6fd2d3c6&role.id=f072ea6ff7ca4dbf90174c318d19acf1 => generated 608 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:21:05.442724 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee3ff99-a863-49f3-9c18-7735fec94ebc None None] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:05.443254 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee3ff99-a863-49f3-9c18-7735fec94ebc None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:05.443254 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee3ff99-a863-49f3-9c18-7735fec94ebc None None] PATH_INFO: `/` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:05.444690 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 105/209] 10.222.0.18 () {54 vars in 927 bytes} [Sat Sep 24 19:21:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:21:05.451657 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58934864-7c20-461d-a56c-c987f4a1099a None None] REQUEST_METHOD: `POST` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:05.452221 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58934864-7c20-461d-a56c-c987f4a1099a None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:05.452221 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58934864-7c20-461d-a56c-c987f4a1099a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:05.472696 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.auth.core [None req-58934864-7c20-461d-a56c-c987f4a1099a None None] MFA Rules not processed for user `3dbbb9909cec43ff99c1c3682f016ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=88081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:21:05.474804 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.fernet_utils [None req-58934864-7c20-461d-a56c-c987f4a1099a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:21:05.566563 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 105/210] 10.222.0.18 () {58 vars in 1024 bytes} [Sat Sep 24 19:21:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:21:05.751127 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da59c4cc-a184-494e-b5c0-f16edf06c9bc None None] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:05.751461 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da59c4cc-a184-494e-b5c0-f16edf06c9bc None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:05.751591 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da59c4cc-a184-494e-b5c0-f16edf06c9bc None None] PATH_INFO: `/` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:05.752968 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 106/211] 10.222.0.18 () {54 vars in 927 bytes} [Sat Sep 24 19:21:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 24 19:21:05.758732 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d34d5fb-a387-4e85-a7ab-04a76c238ae6 None None] REQUEST_METHOD: `POST` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:05.759148 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d34d5fb-a387-4e85-a7ab-04a76c238ae6 None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:05.759860 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d34d5fb-a387-4e85-a7ab-04a76c238ae6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:05.779426 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.auth.core [None req-8d34d5fb-a387-4e85-a7ab-04a76c238ae6 None None] MFA Rules not processed for user `3dbbb9909cec43ff99c1c3682f016ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=88081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:21:05.780758 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.fernet_utils [None req-8d34d5fb-a387-4e85-a7ab-04a76c238ae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:21:05.858754 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 106/212] 10.222.0.18 () {58 vars in 1024 bytes} [Sat Sep 24 19:21:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:21:05.945858 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da59c4cc-a184-494e-b5c0-f16edf06c9bc None None] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:06.051105 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:06.073280 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da59c4cc-a184-494e-b5c0-f16edf06c9bc None None] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:06.111442 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf80d4d-1fb7-4f9c-bad5-7e302ffee949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:06.112338 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf80d4d-1fb7-4f9c-bad5-7e302ffee949 None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:06.112795 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf80d4d-1fb7-4f9c-bad5-7e302ffee949 None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:06.113209 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf80d4d-1fb7-4f9c-bad5-7e302ffee949 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:06.125431 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf80d4d-1fb7-4f9c-bad5-7e302ffee949 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:21:06.131227 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application [None req-3bf80d4d-1fb7-4f9c-bad5-7e302ffee949 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 24 19:21:06.131227 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:21:06.131227 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:21:06.131227 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:21:06.131227 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:21:06.131227 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:21:06.131227 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:21:06.131227 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:21:06.131227 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:21:06.131227 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:21:06.131227 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:21:06.131227 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:21:06.131227 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:21:06.131227 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:21:06.131227 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:21:06.131227 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:21:06.132331 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:21:06.132331 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:21:06.132331 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:21:06.132331 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:21:06.132331 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:21:06.132331 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:21:06.132331 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:21:06.132331 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:21:06.132331 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:21:06.132331 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:21:06.132331 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:21:06.132331 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application with Lock( Sep 24 19:21:06.132331 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:21:06.132331 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:21:06.132331 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:21:06.132331 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:21:06.133290 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:21:06.133290 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:21:06.133290 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:21:06.133290 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:21:06.133290 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:21:06.133290 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:21:06.133290 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:21:06.133290 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:21:06.133290 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:21:06.133290 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:21:06.133290 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 24 19:21:06.133290 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Sep 24 19:21:06.135268 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 107/213] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Sep 24 19:21:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:21:06.145868 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d34d5fb-a387-4e85-a7ab-04a76c238ae6 None None] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:06.145868 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:06.233738 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf80d4d-1fb7-4f9c-bad5-7e302ffee949 None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:06.267606 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d34d5fb-a387-4e85-a7ab-04a76c238ae6 None None] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:06.319502 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8596a183-9821-4fef-89a1-93012a8e918e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:06.320721 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8596a183-9821-4fef-89a1-93012a8e918e None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:06.321090 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8596a183-9821-4fef-89a1-93012a8e918e None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:06.321462 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8596a183-9821-4fef-89a1-93012a8e918e None admin] PATH_INFO: `/v3/roles` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:06.323664 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8596a183-9821-4fef-89a1-93012a8e918e None admin] RBAC: Adding query filter params (name=member) {{(pid=88081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:21:06.323664 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8596a183-9821-4fef-89a1-93012a8e918e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:06.324344 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8596a183-9821-4fef-89a1-93012a8e918e None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:06.334903 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 107/214] 10.222.0.18 () {56 vars in 1101 bytes} [Sat Sep 24 19:21:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:21:06.341277 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8596a183-9821-4fef-89a1-93012a8e918e None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:06.376162 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf80d4d-1fb7-4f9c-bad5-7e302ffee949 None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:06.410372 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:06.418504 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d347f6d-4462-4784-a95d-d18b4cd366eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:06.419746 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d347f6d-4462-4784-a95d-d18b4cd366eb None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:06.420248 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d347f6d-4462-4784-a95d-d18b4cd366eb None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:06.420692 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d347f6d-4462-4784-a95d-d18b4cd366eb None admin] PATH_INFO: `/v3/domains/default` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:06.422708 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d347f6d-4462-4784-a95d-d18b4cd366eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:06.424411 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d347f6d-4462-4784-a95d-d18b4cd366eb None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:06.426647 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 108/215] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Sep 24 19:21:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:21:06.432997 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d347f6d-4462-4784-a95d-d18b4cd366eb None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:06.451862 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:06.474558 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8596a183-9821-4fef-89a1-93012a8e918e None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:06.528338 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5008ddf1-b74a-4c3c-8d9a-1dc9544e165d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:06.529311 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5008ddf1-b74a-4c3c-8d9a-1dc9544e165d None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:06.529767 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5008ddf1-b74a-4c3c-8d9a-1dc9544e165d None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:06.530247 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5008ddf1-b74a-4c3c-8d9a-1dc9544e165d None admin] PATH_INFO: `/v3/users/8c9a05fd5d3a475794970a2dedf5da05` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:06.552442 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5008ddf1-b74a-4c3c-8d9a-1dc9544e165d None admin] RBAC: Authorizing `identity:get_user(user_id=8c9a05fd5d3a475794970a2dedf5da05)` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:06.554153 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5008ddf1-b74a-4c3c-8d9a-1dc9544e165d None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:06.560845 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 108/216] 10.222.0.18 () {56 vars in 1177 bytes} [Sat Sep 24 19:21:06 2022] GET /identity/v3/users/8c9a05fd5d3a475794970a2dedf5da05 => generated 297 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:21:06.562509 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5008ddf1-b74a-4c3c-8d9a-1dc9544e165d None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:06.575330 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d347f6d-4462-4784-a95d-d18b4cd366eb None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:06.632621 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e890ff73-6cc4-44e1-a14a-ba8e45558042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:06.633352 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e890ff73-6cc4-44e1-a14a-ba8e45558042 None admin] REQUEST_METHOD: `POST` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:06.633698 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e890ff73-6cc4-44e1-a14a-ba8e45558042 None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:06.634087 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e890ff73-6cc4-44e1-a14a-ba8e45558042 None admin] PATH_INFO: `/v3/users` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:06.634952 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e890ff73-6cc4-44e1-a14a-ba8e45558042 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:06.636613 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e890ff73-6cc4-44e1-a14a-ba8e45558042 None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:06.667248 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 109/217] 10.222.0.18 () {60 vars in 1132 bytes} [Sat Sep 24 19:21:06 2022] POST /identity/v3/users => generated 297 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 24 19:21:06.702722 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5008ddf1-b74a-4c3c-8d9a-1dc9544e165d None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:06.710417 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c211a52-2e79-41dd-80aa-5b8bb9070a43 None None] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:06.710697 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c211a52-2e79-41dd-80aa-5b8bb9070a43 None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:06.710983 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c211a52-2e79-41dd-80aa-5b8bb9070a43 None None] PATH_INFO: `/` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:06.712444 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 110/218] 10.222.0.18 () {54 vars in 927 bytes} [Sat Sep 24 19:21:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 24 19:21:06.718444 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1500808f-9c85-4d14-be9d-79410177c6ae None None] REQUEST_METHOD: `POST` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:06.718750 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1500808f-9c85-4d14-be9d-79410177c6ae None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:06.718995 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1500808f-9c85-4d14-be9d-79410177c6ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:06.735338 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:06.742984 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.auth.core [None req-1500808f-9c85-4d14-be9d-79410177c6ae None None] MFA Rules not processed for user `3dbbb9909cec43ff99c1c3682f016ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=88080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:21:06.744398 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.fernet_utils [None req-1500808f-9c85-4d14-be9d-79410177c6ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:21:06.752193 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ea559c-81d6-4e78-9513-6d0e2db5e750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:06.753164 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ea559c-81d6-4e78-9513-6d0e2db5e750 None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:06.753630 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ea559c-81d6-4e78-9513-6d0e2db5e750 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:06.755458 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ea559c-81d6-4e78-9513-6d0e2db5e750 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:06.832212 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:06.847418 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 111/219] 10.222.0.18 () {58 vars in 1024 bytes} [Sat Sep 24 19:21:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:21:06.851093 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e80da9-f692-4dfd-8b2c-e86a4f933bce None None] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:06.851670 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e80da9-f692-4dfd-8b2c-e86a4f933bce None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:06.852097 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e80da9-f692-4dfd-8b2c-e86a4f933bce None None] PATH_INFO: `/` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:06.854792 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 112/220] 10.222.0.18 () {54 vars in 927 bytes} [Sat Sep 24 19:21:06 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:21:06.864758 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677266fe-48e1-4616-84d7-6fcaf5c895f5 None None] REQUEST_METHOD: `POST` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:06.865392 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677266fe-48e1-4616-84d7-6fcaf5c895f5 None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:06.865982 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677266fe-48e1-4616-84d7-6fcaf5c895f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:06.867864 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ea559c-81d6-4e78-9513-6d0e2db5e750 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:06.869678 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ea559c-81d6-4e78-9513-6d0e2db5e750 None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:06.901183 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.auth.core [None req-677266fe-48e1-4616-84d7-6fcaf5c895f5 None None] MFA Rules not processed for user `3dbbb9909cec43ff99c1c3682f016ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=88080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:21:06.902919 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.fernet_utils [None req-677266fe-48e1-4616-84d7-6fcaf5c895f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:21:06.999060 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 113/221] 10.222.0.18 () {58 vars in 1024 bytes} [Sat Sep 24 19:21:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:21:07.019104 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 109/222] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Sep 24 19:21:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 24 19:21:07.025038 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677266fe-48e1-4616-84d7-6fcaf5c895f5 None None] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:07.141940 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677266fe-48e1-4616-84d7-6fcaf5c895f5 None None] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:07.170444 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ea559c-81d6-4e78-9513-6d0e2db5e750 None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:07.172592 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:07.185255 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c2c25c-430b-4423-9773-8c4a7b8de58a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:07.186676 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c2c25c-430b-4423-9773-8c4a7b8de58a None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:07.186676 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c2c25c-430b-4423-9773-8c4a7b8de58a None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:07.186852 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c2c25c-430b-4423-9773-8c4a7b8de58a None admin] PATH_INFO: `/v3/projects/b86798f4dc4d4dd79428558b3d00ae1a` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:07.188059 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c2c25c-430b-4423-9773-8c4a7b8de58a None admin] RBAC: Authorizing `identity:get_project(project_id=b86798f4dc4d4dd79428558b3d00ae1a)` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:07.191443 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c2c25c-430b-4423-9773-8c4a7b8de58a None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:07.193065 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 114/223] 10.222.0.18 () {56 vars in 1186 bytes} [Sat Sep 24 19:21:07 2022] GET /identity/v3/projects/b86798f4dc4d4dd79428558b3d00ae1a => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:21:07.198066 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:07.199438 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c2c25c-430b-4423-9773-8c4a7b8de58a None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:07.300854 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ea559c-81d6-4e78-9513-6d0e2db5e750 None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:07.340568 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bcded3-5255-45ab-a9e9-8b384cf2d1a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:07.341197 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bcded3-5255-45ab-a9e9-8b384cf2d1a9 None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:07.341470 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bcded3-5255-45ab-a9e9-8b384cf2d1a9 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:07.341735 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bcded3-5255-45ab-a9e9-8b384cf2d1a9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:07.342590 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c2c25c-430b-4423-9773-8c4a7b8de58a None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:07.353805 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bcded3-5255-45ab-a9e9-8b384cf2d1a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:21:07.358950 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application [None req-33bcded3-5255-45ab-a9e9-8b384cf2d1a9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 19:21:07.358950 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:21:07.358950 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:21:07.358950 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:21:07.358950 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:21:07.358950 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:21:07.358950 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:21:07.358950 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:21:07.358950 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:21:07.358950 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:21:07.358950 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:21:07.358950 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:21:07.358950 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:21:07.358950 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:21:07.358950 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:21:07.358950 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:21:07.359858 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:21:07.359858 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:21:07.359858 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:21:07.359858 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:21:07.359858 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:21:07.359858 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:21:07.359858 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:21:07.359858 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:21:07.359858 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:21:07.359858 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:21:07.359858 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:21:07.359858 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application with Lock( Sep 24 19:21:07.359858 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:21:07.359858 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:21:07.359858 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:21:07.359858 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:21:07.360700 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:21:07.360700 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:21:07.360700 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:21:07.360700 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:21:07.360700 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:21:07.360700 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:21:07.360700 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:21:07.360700 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:21:07.360700 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:21:07.360700 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:21:07.360700 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 19:21:07.360700 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Sep 24 19:21:07.360700 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 110/224] 10.222.0.18 () {56 vars in 1096 bytes} [Sat Sep 24 19:21:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:21:07.365897 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bcded3-5255-45ab-a9e9-8b384cf2d1a9 None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:07.389275 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec82cbf8-7d69-4130-9391-7ff1419cfea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:07.390512 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec82cbf8-7d69-4130-9391-7ff1419cfea8 None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:07.391270 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec82cbf8-7d69-4130-9391-7ff1419cfea8 None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:07.391748 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec82cbf8-7d69-4130-9391-7ff1419cfea8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:07.393158 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec82cbf8-7d69-4130-9391-7ff1419cfea8 None admin] RBAC: Adding query filter params (role.id=3a42524fc57c4487a34c5c05234413a7, scope.project.id=b86798f4dc4d4dd79428558b3d00ae1a, user.id=8c9a05fd5d3a475794970a2dedf5da05) {{(pid=88080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:21:07.393673 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec82cbf8-7d69-4130-9391-7ff1419cfea8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:07.396611 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec82cbf8-7d69-4130-9391-7ff1419cfea8 None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:07.405187 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 115/225] 10.222.0.18 () {56 vars in 1374 bytes} [Sat Sep 24 19:21:07 2022] GET /identity/v3/role_assignments?user.id=8c9a05fd5d3a475794970a2dedf5da05&scope.project.id=b86798f4dc4d4dd79428558b3d00ae1a&role.id=3a42524fc57c4487a34c5c05234413a7 => generated 259 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:21:07.406675 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec82cbf8-7d69-4130-9391-7ff1419cfea8 None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:07.482205 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:07.534313 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec82cbf8-7d69-4130-9391-7ff1419cfea8 None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:07.563949 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:07.604297 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08d6884-b636-4fbf-acb3-eeae66af243c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:07.604949 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08d6884-b636-4fbf-acb3-eeae66af243c None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:07.605227 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08d6884-b636-4fbf-acb3-eeae66af243c None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:07.605496 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08d6884-b636-4fbf-acb3-eeae66af243c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:07.612140 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bcded3-5255-45ab-a9e9-8b384cf2d1a9 None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:07.620798 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08d6884-b636-4fbf-acb3-eeae66af243c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:21:07.626614 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application [None req-f08d6884-b636-4fbf-acb3-eeae66af243c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 24 19:21:07.626614 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:21:07.626614 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:21:07.626614 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:21:07.626614 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:21:07.626614 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:21:07.626614 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:21:07.626614 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:21:07.626614 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:21:07.626614 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:21:07.626614 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:21:07.626614 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:21:07.626614 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:21:07.626614 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:21:07.626614 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:21:07.626614 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:21:07.627551 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:21:07.627551 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:21:07.627551 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:21:07.627551 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:21:07.627551 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:21:07.627551 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:21:07.627551 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:21:07.627551 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:21:07.627551 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:21:07.627551 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:21:07.627551 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:21:07.627551 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application with Lock( Sep 24 19:21:07.627551 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:21:07.627551 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:21:07.627551 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:21:07.627551 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:21:07.628375 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:21:07.628375 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:21:07.628375 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:21:07.628375 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:21:07.628375 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:21:07.628375 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:21:07.628375 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:21:07.628375 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:21:07.628375 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:21:07.628375 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:21:07.628375 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 24 19:21:07.628375 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Sep 24 19:21:07.629685 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 116/226] 10.222.0.18 () {56 vars in 1114 bytes} [Sat Sep 24 19:21:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:21:07.639409 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08d6884-b636-4fbf-acb3-eeae66af243c None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:07.700047 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fdd9c0-a46a-4566-8ae5-45e0331f65bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:07.701029 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fdd9c0-a46a-4566-8ae5-45e0331f65bb None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:07.701509 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fdd9c0-a46a-4566-8ae5-45e0331f65bb None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:07.702030 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fdd9c0-a46a-4566-8ae5-45e0331f65bb None admin] PATH_INFO: `/v3/roles` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:07.703191 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fdd9c0-a46a-4566-8ae5-45e0331f65bb None admin] RBAC: Adding query filter params (name=admin) {{(pid=88081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:21:07.704167 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fdd9c0-a46a-4566-8ae5-45e0331f65bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:07.706255 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fdd9c0-a46a-4566-8ae5-45e0331f65bb None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:07.719234 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 111/227] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Sep 24 19:21:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:21:07.729354 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fdd9c0-a46a-4566-8ae5-45e0331f65bb None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:07.789862 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08d6884-b636-4fbf-acb3-eeae66af243c None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:07.822143 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:07.857412 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea030491-a5be-4b19-bc3a-8e9c72c9c830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:07.858072 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea030491-a5be-4b19-bc3a-8e9c72c9c830 None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:07.858392 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea030491-a5be-4b19-bc3a-8e9c72c9c830 None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:07.858667 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea030491-a5be-4b19-bc3a-8e9c72c9c830 None admin] PATH_INFO: `/v3/roles` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:07.859339 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea030491-a5be-4b19-bc3a-8e9c72c9c830 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:21:07.859641 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea030491-a5be-4b19-bc3a-8e9c72c9c830 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:07.861020 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea030491-a5be-4b19-bc3a-8e9c72c9c830 None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:07.870084 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 117/228] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Sep 24 19:21:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:21:07.883064 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea030491-a5be-4b19-bc3a-8e9c72c9c830 None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:07.888363 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fdd9c0-a46a-4566-8ae5-45e0331f65bb None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:07.924771 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a79a035-705f-4019-ae2c-9f3dfb5570bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:07.925421 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a79a035-705f-4019-ae2c-9f3dfb5570bf None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:07.925690 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a79a035-705f-4019-ae2c-9f3dfb5570bf None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:07.926053 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a79a035-705f-4019-ae2c-9f3dfb5570bf None admin] PATH_INFO: `/v3/users/e15d6166e0bc4bf585c618e905a89a84` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:07.927234 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a79a035-705f-4019-ae2c-9f3dfb5570bf None admin] RBAC: Authorizing `identity:get_user(user_id=e15d6166e0bc4bf585c618e905a89a84)` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:07.928683 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a79a035-705f-4019-ae2c-9f3dfb5570bf None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:07.930611 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 112/229] 10.222.0.18 () {56 vars in 1177 bytes} [Sat Sep 24 19:21:07 2022] GET /identity/v3/users/e15d6166e0bc4bf585c618e905a89a84 => generated 283 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:21:07.935993 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a79a035-705f-4019-ae2c-9f3dfb5570bf None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:07.958949 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:08.044135 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea030491-a5be-4b19-bc3a-8e9c72c9c830 None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:08.069243 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a79a035-705f-4019-ae2c-9f3dfb5570bf None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:08.106771 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255cd5c6-7669-4f08-ac73-10bd92623c04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:08.107406 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255cd5c6-7669-4f08-ac73-10bd92623c04 None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:08.107679 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255cd5c6-7669-4f08-ac73-10bd92623c04 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:08.107946 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255cd5c6-7669-4f08-ac73-10bd92623c04 None admin] PATH_INFO: `/v3/projects/b86798f4dc4d4dd79428558b3d00ae1a` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:08.109845 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255cd5c6-7669-4f08-ac73-10bd92623c04 None admin] RBAC: Authorizing `identity:get_project(project_id=b86798f4dc4d4dd79428558b3d00ae1a)` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:08.111864 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255cd5c6-7669-4f08-ac73-10bd92623c04 None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:08.114015 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 113/230] 10.222.0.18 () {56 vars in 1186 bytes} [Sat Sep 24 19:21:07 2022] GET /identity/v3/projects/b86798f4dc4d4dd79428558b3d00ae1a => generated 302 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:21:08.122576 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255cd5c6-7669-4f08-ac73-10bd92623c04 None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:08.124075 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1f7843-2148-407e-bf2b-9119c668b189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:08.124715 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1f7843-2148-407e-bf2b-9119c668b189 None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:08.124988 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1f7843-2148-407e-bf2b-9119c668b189 None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:08.125255 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1f7843-2148-407e-bf2b-9119c668b189 None admin] PATH_INFO: `/v3/users/e15d6166e0bc4bf585c618e905a89a84` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:08.126405 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1f7843-2148-407e-bf2b-9119c668b189 None admin] RBAC: Authorizing `identity:get_user(user_id=e15d6166e0bc4bf585c618e905a89a84)` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:08.127866 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1f7843-2148-407e-bf2b-9119c668b189 None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:08.134235 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 118/231] 10.222.0.18 () {56 vars in 1177 bytes} [Sat Sep 24 19:21:07 2022] GET /identity/v3/users/e15d6166e0bc4bf585c618e905a89a84 => generated 283 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:21:08.135291 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1f7843-2148-407e-bf2b-9119c668b189 None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:08.227864 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:08.244814 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:08.264449 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255cd5c6-7669-4f08-ac73-10bd92623c04 None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:08.299135 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaec3de9-6574-40cc-83ff-418d0dd28245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:08.299853 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaec3de9-6574-40cc-83ff-418d0dd28245 None admin] REQUEST_METHOD: `PUT` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:08.300131 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaec3de9-6574-40cc-83ff-418d0dd28245 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:08.300396 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaec3de9-6574-40cc-83ff-418d0dd28245 None admin] PATH_INFO: `/v3/projects/b86798f4dc4d4dd79428558b3d00ae1a/users/e15d6166e0bc4bf585c618e905a89a84/roles/4c7d0dafc19b4b0a9821be6ec0da0a8f` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:08.303007 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaec3de9-6574-40cc-83ff-418d0dd28245 None admin] RBAC: Authorizing `identity:create_grant(project_id=b86798f4dc4d4dd79428558b3d00ae1a, user_id=e15d6166e0bc4bf585c618e905a89a84, role_id=4c7d0dafc19b4b0a9821be6ec0da0a8f)` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:08.304494 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaec3de9-6574-40cc-83ff-418d0dd28245 None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:08.319373 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1f7843-2148-407e-bf2b-9119c668b189 None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:08.333213 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 114/232] 10.222.0.18 () {58 vars in 1439 bytes} [Sat Sep 24 19:21:08 2022] PUT /identity/v3/projects/b86798f4dc4d4dd79428558b3d00ae1a/users/e15d6166e0bc4bf585c618e905a89a84/roles/4c7d0dafc19b4b0a9821be6ec0da0a8f => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:21:08.382265 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3dc3fe-a03a-454d-8897-9375f31b43b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:08.382937 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3dc3fe-a03a-454d-8897-9375f31b43b7 None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:08.383222 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3dc3fe-a03a-454d-8897-9375f31b43b7 None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:08.383498 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3dc3fe-a03a-454d-8897-9375f31b43b7 None admin] PATH_INFO: `/v3/projects/b86798f4dc4d4dd79428558b3d00ae1a` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:08.386100 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3dc3fe-a03a-454d-8897-9375f31b43b7 None admin] RBAC: Authorizing `identity:get_project(project_id=b86798f4dc4d4dd79428558b3d00ae1a)` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:08.387738 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3dc3fe-a03a-454d-8897-9375f31b43b7 None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:08.389616 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 119/233] 10.222.0.18 () {56 vars in 1186 bytes} [Sat Sep 24 19:21:08 2022] GET /identity/v3/projects/b86798f4dc4d4dd79428558b3d00ae1a => generated 302 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:21:08.396343 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaec3de9-6574-40cc-83ff-418d0dd28245 None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:08.537048 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaec3de9-6574-40cc-83ff-418d0dd28245 None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:08.580488 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310e7c08-e197-4079-bcb9-4cf917273ca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:08.581914 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310e7c08-e197-4079-bcb9-4cf917273ca3 None admin] REQUEST_METHOD: `PUT` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:08.582460 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310e7c08-e197-4079-bcb9-4cf917273ca3 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:08.582872 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310e7c08-e197-4079-bcb9-4cf917273ca3 None admin] PATH_INFO: `/v3/projects/b86798f4dc4d4dd79428558b3d00ae1a/users/e15d6166e0bc4bf585c618e905a89a84/roles/a24280fb630f4c17865458d833144b17` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:08.585195 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310e7c08-e197-4079-bcb9-4cf917273ca3 None admin] RBAC: Authorizing `identity:create_grant(project_id=b86798f4dc4d4dd79428558b3d00ae1a, user_id=e15d6166e0bc4bf585c618e905a89a84, role_id=a24280fb630f4c17865458d833144b17)` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:08.586967 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310e7c08-e197-4079-bcb9-4cf917273ca3 None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:08.602950 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:08.607545 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 115/234] 10.222.0.18 () {58 vars in 1439 bytes} [Sat Sep 24 19:21:08 2022] PUT /identity/v3/projects/b86798f4dc4d4dd79428558b3d00ae1a/users/e15d6166e0bc4bf585c618e905a89a84/roles/a24280fb630f4c17865458d833144b17 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 24 19:21:09.821473 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8d6ab3-7e3d-472f-9c6e-2685f10922da None None] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:09.821473 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8d6ab3-7e3d-472f-9c6e-2685f10922da None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:09.821473 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8d6ab3-7e3d-472f-9c6e-2685f10922da None None] PATH_INFO: `/` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:09.821473 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 120/235] 10.222.0.18 () {54 vars in 927 bytes} [Sat Sep 24 19:21:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:21:09.826972 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ec10dd-8654-4b12-ac41-ec153e69b7d0 None None] REQUEST_METHOD: `POST` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:09.827768 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ec10dd-8654-4b12-ac41-ec153e69b7d0 None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:09.828261 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ec10dd-8654-4b12-ac41-ec153e69b7d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:09.850008 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.auth.core [None req-28ec10dd-8654-4b12-ac41-ec153e69b7d0 None None] MFA Rules not processed for user `3dbbb9909cec43ff99c1c3682f016ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=88081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:21:09.851586 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.fernet_utils [None req-28ec10dd-8654-4b12-ac41-ec153e69b7d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:21:09.908043 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b45d7d-9673-4025-8345-91b22214a68a None None] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:09.908043 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b45d7d-9673-4025-8345-91b22214a68a None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:09.908043 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b45d7d-9673-4025-8345-91b22214a68a None None] PATH_INFO: `/` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:09.908043 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 121/236] 10.222.0.18 () {54 vars in 927 bytes} [Sat Sep 24 19:21:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:21:09.914540 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517088bd-0952-42ac-8441-155f9755bfab None None] REQUEST_METHOD: `POST` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:09.915105 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517088bd-0952-42ac-8441-155f9755bfab None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:09.915567 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517088bd-0952-42ac-8441-155f9755bfab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:09.934351 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.auth.core [None req-517088bd-0952-42ac-8441-155f9755bfab None None] MFA Rules not processed for user `3dbbb9909cec43ff99c1c3682f016ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=88080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:21:09.935856 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.fernet_utils [None req-517088bd-0952-42ac-8441-155f9755bfab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:21:09.967685 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 116/237] 10.222.0.18 () {58 vars in 1024 bytes} [Sat Sep 24 19:21:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:21:10.017186 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 122/238] 10.222.0.18 () {58 vars in 1024 bytes} [Sat Sep 24 19:21:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 24 19:21:10.359441 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ec10dd-8654-4b12-ac41-ec153e69b7d0 None None] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:10.442577 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517088bd-0952-42ac-8441-155f9755bfab None None] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:10.493057 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ec10dd-8654-4b12-ac41-ec153e69b7d0 None None] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:10.494177 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:10.554542 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:10.558439 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517088bd-0952-42ac-8441-155f9755bfab None None] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:10.560808 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd4ac7f-2d4e-4786-9eb4-f6ae5ace2d37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:10.562936 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd4ac7f-2d4e-4786-9eb4-f6ae5ace2d37 None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:10.562936 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd4ac7f-2d4e-4786-9eb4-f6ae5ace2d37 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:10.562936 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd4ac7f-2d4e-4786-9eb4-f6ae5ace2d37 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:10.564133 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd4ac7f-2d4e-4786-9eb4-f6ae5ace2d37 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:10.566305 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd4ac7f-2d4e-4786-9eb4-f6ae5ace2d37 None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:10.568362 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 117/239] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Sep 24 19:21:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:21:10.574077 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd4ac7f-2d4e-4786-9eb4-f6ae5ace2d37 None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:10.601933 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf9fe1f-3462-41fb-9715-af84cfb668e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:10.602925 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf9fe1f-3462-41fb-9715-af84cfb668e9 None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:10.603339 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf9fe1f-3462-41fb-9715-af84cfb668e9 None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:10.603745 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf9fe1f-3462-41fb-9715-af84cfb668e9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:10.616135 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf9fe1f-3462-41fb-9715-af84cfb668e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:21:10.621686 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application [None req-7cf9fe1f-3462-41fb-9715-af84cfb668e9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 24 19:21:10.621686 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:21:10.621686 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:21:10.621686 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:21:10.621686 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:21:10.621686 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:21:10.621686 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:21:10.621686 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:21:10.621686 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:21:10.621686 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:21:10.621686 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:21:10.621686 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:21:10.621686 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:21:10.621686 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:21:10.621686 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:21:10.621686 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:21:10.622652 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:21:10.622652 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:21:10.622652 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:21:10.622652 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:21:10.622652 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:21:10.622652 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:21:10.622652 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:21:10.622652 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:21:10.622652 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:21:10.622652 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:21:10.622652 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:21:10.622652 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application with Lock( Sep 24 19:21:10.622652 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:21:10.622652 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:21:10.622652 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:21:10.622652 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:21:10.623432 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:21:10.623432 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:21:10.623432 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:21:10.623432 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:21:10.623432 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:21:10.623432 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:21:10.623432 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:21:10.623432 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:21:10.623432 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:21:10.623432 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:21:10.623432 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 24 19:21:10.623432 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Sep 24 19:21:10.625683 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 123/240] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Sep 24 19:21:10 2022] GET /identity/v3/roles/reader => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 19:21:10.633963 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf9fe1f-3462-41fb-9715-af84cfb668e9 None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:10.684713 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd4ac7f-2d4e-4786-9eb4-f6ae5ace2d37 None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:10.723226 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0f3e61-d15a-41b7-9ec7-dca71b5bc600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:10.724011 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0f3e61-d15a-41b7-9ec7-dca71b5bc600 None admin] REQUEST_METHOD: `POST` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:10.724351 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0f3e61-d15a-41b7-9ec7-dca71b5bc600 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:10.724973 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0f3e61-d15a-41b7-9ec7-dca71b5bc600 None admin] PATH_INFO: `/v3/users` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:10.725422 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0f3e61-d15a-41b7-9ec7-dca71b5bc600 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:10.733280 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0f3e61-d15a-41b7-9ec7-dca71b5bc600 None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:10.762175 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf9fe1f-3462-41fb-9715-af84cfb668e9 None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:10.767423 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 118/241] 10.222.0.18 () {60 vars in 1132 bytes} [Sat Sep 24 19:21:10 2022] POST /identity/v3/users => generated 293 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 24 19:21:10.772729 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:10.803909 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8061e26b-6685-4f19-908e-cd8aac1aa175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:10.804921 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8061e26b-6685-4f19-908e-cd8aac1aa175 None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:10.805392 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8061e26b-6685-4f19-908e-cd8aac1aa175 None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:10.805956 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8061e26b-6685-4f19-908e-cd8aac1aa175 None admin] PATH_INFO: `/v3/roles` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:10.806832 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8061e26b-6685-4f19-908e-cd8aac1aa175 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:21:10.807327 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8061e26b-6685-4f19-908e-cd8aac1aa175 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:10.808968 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8061e26b-6685-4f19-908e-cd8aac1aa175 None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:10.819391 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 124/242] 10.222.0.18 () {56 vars in 1101 bytes} [Sat Sep 24 19:21:10 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:21:10.825815 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0f3e61-d15a-41b7-9ec7-dca71b5bc600 None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:10.855301 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c39ac1b-e956-4101-9f76-de544cb21183 None None] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:10.856673 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c39ac1b-e956-4101-9f76-de544cb21183 None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:10.857431 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c39ac1b-e956-4101-9f76-de544cb21183 None None] PATH_INFO: `/` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:10.860018 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 125/243] 10.222.0.18 () {54 vars in 927 bytes} [Sat Sep 24 19:21:10 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:21:10.868542 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b91fa27-4c83-4f7e-b618-9a5b269d91e6 None None] REQUEST_METHOD: `POST` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:10.869353 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b91fa27-4c83-4f7e-b618-9a5b269d91e6 None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:10.870086 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b91fa27-4c83-4f7e-b618-9a5b269d91e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:10.905626 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:10.919067 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.auth.core [None req-4b91fa27-4c83-4f7e-b618-9a5b269d91e6 None None] MFA Rules not processed for user `3dbbb9909cec43ff99c1c3682f016ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=88080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:21:10.920528 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.fernet_utils [None req-4b91fa27-4c83-4f7e-b618-9a5b269d91e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:21:10.962075 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0f3e61-d15a-41b7-9ec7-dca71b5bc600 None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:11.006774 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf89336-f2cf-4c2a-8df8-6e629cbe95c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:11.007753 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf89336-f2cf-4c2a-8df8-6e629cbe95c3 None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:11.008127 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf89336-f2cf-4c2a-8df8-6e629cbe95c3 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:11.008494 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf89336-f2cf-4c2a-8df8-6e629cbe95c3 None admin] PATH_INFO: `/v3/users/d2653aeb65964617a83dd1b899f8a540` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:11.024550 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf89336-f2cf-4c2a-8df8-6e629cbe95c3 None admin] RBAC: Authorizing `identity:get_user(user_id=d2653aeb65964617a83dd1b899f8a540)` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:11.026403 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf89336-f2cf-4c2a-8df8-6e629cbe95c3 None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:11.028791 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 119/244] 10.222.0.18 () {56 vars in 1177 bytes} [Sat Sep 24 19:21:10 2022] GET /identity/v3/users/d2653aeb65964617a83dd1b899f8a540 => generated 297 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:21:11.034988 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf89336-f2cf-4c2a-8df8-6e629cbe95c3 None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:11.061779 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 126/245] 10.222.0.18 () {58 vars in 1024 bytes} [Sat Sep 24 19:21:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:21:11.205953 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf89336-f2cf-4c2a-8df8-6e629cbe95c3 None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:11.220029 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:11.244623 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396ee482-0671-4f36-8f0d-f4c86bc67d27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:11.245264 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396ee482-0671-4f36-8f0d-f4c86bc67d27 None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:11.245541 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396ee482-0671-4f36-8f0d-f4c86bc67d27 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:11.245810 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396ee482-0671-4f36-8f0d-f4c86bc67d27 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:11.323283 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396ee482-0671-4f36-8f0d-f4c86bc67d27 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:11.324768 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396ee482-0671-4f36-8f0d-f4c86bc67d27 None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:11.429259 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b91fa27-4c83-4f7e-b618-9a5b269d91e6 None None] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:11.436303 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 120/246] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Sep 24 19:21:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 24 19:21:11.442623 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396ee482-0671-4f36-8f0d-f4c86bc67d27 None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:11.460662 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:11.570849 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:11.575959 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396ee482-0671-4f36-8f0d-f4c86bc67d27 None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:11.577115 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b91fa27-4c83-4f7e-b618-9a5b269d91e6 None None] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:11.620271 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69006b87-57f8-433a-bcdb-6676767f7425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:11.620950 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69006b87-57f8-433a-bcdb-6676767f7425 None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:11.621226 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69006b87-57f8-433a-bcdb-6676767f7425 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:11.621494 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69006b87-57f8-433a-bcdb-6676767f7425 None admin] PATH_INFO: `/v3/projects/b86798f4dc4d4dd79428558b3d00ae1a` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:11.623325 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69006b87-57f8-433a-bcdb-6676767f7425 None admin] RBAC: Authorizing `identity:get_project(project_id=b86798f4dc4d4dd79428558b3d00ae1a)` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:11.624989 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69006b87-57f8-433a-bcdb-6676767f7425 None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:11.627385 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 121/247] 10.222.0.18 () {56 vars in 1186 bytes} [Sat Sep 24 19:21:11 2022] GET /identity/v3/projects/b86798f4dc4d4dd79428558b3d00ae1a => generated 302 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:21:11.631534 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcd64a6-27a0-4b45-a020-2e0108e827ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:11.632534 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcd64a6-27a0-4b45-a020-2e0108e827ba None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:11.633025 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcd64a6-27a0-4b45-a020-2e0108e827ba None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:11.633493 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcd64a6-27a0-4b45-a020-2e0108e827ba None admin] PATH_INFO: `/v3/roles/member` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:11.634635 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69006b87-57f8-433a-bcdb-6676767f7425 None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:11.655179 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcd64a6-27a0-4b45-a020-2e0108e827ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:21:11.663016 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application [None req-ffcd64a6-27a0-4b45-a020-2e0108e827ba None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 24 19:21:11.663016 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:21:11.663016 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:21:11.663016 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:21:11.663016 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:21:11.663016 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:21:11.663016 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:21:11.663016 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:21:11.663016 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:21:11.663016 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:21:11.663016 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:21:11.663016 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:21:11.663016 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:21:11.663016 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:21:11.663016 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:21:11.663016 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:21:11.663923 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:21:11.663923 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:21:11.663923 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:21:11.663923 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:21:11.663923 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:21:11.663923 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:21:11.663923 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:21:11.663923 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:21:11.663923 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:21:11.663923 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:21:11.663923 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:21:11.663923 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application with Lock( Sep 24 19:21:11.663923 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:21:11.663923 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:21:11.663923 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:21:11.663923 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:21:11.664699 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:21:11.664699 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:21:11.664699 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:21:11.664699 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:21:11.664699 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:21:11.664699 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:21:11.664699 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:21:11.664699 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:21:11.664699 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:21:11.664699 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:21:11.664699 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 24 19:21:11.664699 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Sep 24 19:21:11.666992 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 127/248] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Sep 24 19:21:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 19:21:11.674380 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcd64a6-27a0-4b45-a020-2e0108e827ba None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:11.747149 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:11.776938 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69006b87-57f8-433a-bcdb-6676767f7425 None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:11.814333 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcd64a6-27a0-4b45-a020-2e0108e827ba None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:11.824906 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6907f06-7f44-454d-9aef-b3a9355b32c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:11.825524 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6907f06-7f44-454d-9aef-b3a9355b32c2 None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:11.825807 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6907f06-7f44-454d-9aef-b3a9355b32c2 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:11.826497 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6907f06-7f44-454d-9aef-b3a9355b32c2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:11.827246 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6907f06-7f44-454d-9aef-b3a9355b32c2 None admin] RBAC: Adding query filter params (role.id=f072ea6ff7ca4dbf90174c318d19acf1, scope.project.id=b86798f4dc4d4dd79428558b3d00ae1a, user.id=d2653aeb65964617a83dd1b899f8a540) {{(pid=88081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:21:11.827555 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6907f06-7f44-454d-9aef-b3a9355b32c2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:11.829636 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6907f06-7f44-454d-9aef-b3a9355b32c2 None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:11.837261 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 122/249] 10.222.0.18 () {56 vars in 1374 bytes} [Sat Sep 24 19:21:11 2022] GET /identity/v3/role_assignments?user.id=d2653aeb65964617a83dd1b899f8a540&scope.project.id=b86798f4dc4d4dd79428558b3d00ae1a&role.id=f072ea6ff7ca4dbf90174c318d19acf1 => generated 259 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:21:11.841862 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3957ec5-3959-473d-b2e4-4c2990a53929 None None] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:11.842153 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3957ec5-3959-473d-b2e4-4c2990a53929 None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:11.842432 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3957ec5-3959-473d-b2e4-4c2990a53929 None None] PATH_INFO: `/` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:11.843773 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 123/250] 10.222.0.18 () {54 vars in 927 bytes} [Sat Sep 24 19:21:11 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:21:11.856145 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0a2f42-2268-4468-907b-c566bd898f62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:11.856825 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0a2f42-2268-4468-907b-c566bd898f62 None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:11.857048 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0a2f42-2268-4468-907b-c566bd898f62 None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:11.857321 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0a2f42-2268-4468-907b-c566bd898f62 None admin] PATH_INFO: `/v3/roles` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:11.858121 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0a2f42-2268-4468-907b-c566bd898f62 None admin] RBAC: Adding query filter params (name=member) {{(pid=88080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:21:11.858431 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0a2f42-2268-4468-907b-c566bd898f62 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:11.859882 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0a2f42-2268-4468-907b-c566bd898f62 None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:11.860842 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd3edb1-0bdb-4d25-893e-7926a12d91b6 None None] REQUEST_METHOD: `POST` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:11.861125 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd3edb1-0bdb-4d25-893e-7926a12d91b6 None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:11.861667 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd3edb1-0bdb-4d25-893e-7926a12d91b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:11.871707 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 128/251] 10.222.0.18 () {56 vars in 1101 bytes} [Sat Sep 24 19:21:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:21:11.877448 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0a2f42-2268-4468-907b-c566bd898f62 None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:11.905338 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:11.911194 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.auth.core [None req-bdd3edb1-0bdb-4d25-893e-7926a12d91b6 None None] MFA Rules not processed for user `3dbbb9909cec43ff99c1c3682f016ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=88081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:21:11.912423 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.fernet_utils [None req-bdd3edb1-0bdb-4d25-893e-7926a12d91b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:21:12.013077 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0a2f42-2268-4468-907b-c566bd898f62 None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:12.059366 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e8db56-b0b2-4aa1-b50f-799e0c45e135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:12.060021 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e8db56-b0b2-4aa1-b50f-799e0c45e135 None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:12.060297 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e8db56-b0b2-4aa1-b50f-799e0c45e135 None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:12.060568 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e8db56-b0b2-4aa1-b50f-799e0c45e135 None admin] PATH_INFO: `/v3/users/8c9a05fd5d3a475794970a2dedf5da05` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:12.061855 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e8db56-b0b2-4aa1-b50f-799e0c45e135 None admin] RBAC: Authorizing `identity:get_user(user_id=8c9a05fd5d3a475794970a2dedf5da05)` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:12.063636 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e8db56-b0b2-4aa1-b50f-799e0c45e135 None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:12.065675 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 129/252] 10.222.0.18 () {56 vars in 1177 bytes} [Sat Sep 24 19:21:11 2022] GET /identity/v3/users/8c9a05fd5d3a475794970a2dedf5da05 => generated 297 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:21:12.067395 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce08079-6ce8-41fc-9502-5d587518b628 None None] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:12.067673 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce08079-6ce8-41fc-9502-5d587518b628 None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:12.067946 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce08079-6ce8-41fc-9502-5d587518b628 None None] PATH_INFO: `/` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:12.074648 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 130/253] 10.222.0.18 () {54 vars in 927 bytes} [Sat Sep 24 19:21:12 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:21:12.075539 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce08079-6ce8-41fc-9502-5d587518b628 None None] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:12.155476 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 124/254] 10.222.0.18 () {58 vars in 1024 bytes} [Sat Sep 24 19:21:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 24 19:21:12.156725 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddd62a1-2fd7-4e46-a47d-105b31bc7da6 None None] REQUEST_METHOD: `POST` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:12.157024 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddd62a1-2fd7-4e46-a47d-105b31bc7da6 None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:12.157301 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddd62a1-2fd7-4e46-a47d-105b31bc7da6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:12.191946 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.auth.core [None req-fddd62a1-2fd7-4e46-a47d-105b31bc7da6 None None] MFA Rules not processed for user `3dbbb9909cec43ff99c1c3682f016ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=88081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:21:12.193280 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.fernet_utils [None req-fddd62a1-2fd7-4e46-a47d-105b31bc7da6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:21:12.277897 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:12.316237 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 125/255] 10.222.0.18 () {58 vars in 1024 bytes} [Sat Sep 24 19:21:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:21:12.327113 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce08079-6ce8-41fc-9502-5d587518b628 None None] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:12.392680 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211ec5d7-e29e-4ace-86ad-837cdaf63c47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:12.393890 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211ec5d7-e29e-4ace-86ad-837cdaf63c47 None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:12.394407 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211ec5d7-e29e-4ace-86ad-837cdaf63c47 None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:12.394869 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211ec5d7-e29e-4ace-86ad-837cdaf63c47 None admin] PATH_INFO: `/v3/projects/b86798f4dc4d4dd79428558b3d00ae1a` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:12.398519 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211ec5d7-e29e-4ace-86ad-837cdaf63c47 None admin] RBAC: Authorizing `identity:get_project(project_id=b86798f4dc4d4dd79428558b3d00ae1a)` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:12.400202 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211ec5d7-e29e-4ace-86ad-837cdaf63c47 None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:12.402508 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 131/256] 10.222.0.18 () {56 vars in 1186 bytes} [Sat Sep 24 19:21:12 2022] GET /identity/v3/projects/b86798f4dc4d4dd79428558b3d00ae1a => generated 302 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:21:12.408100 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddd62a1-2fd7-4e46-a47d-105b31bc7da6 None None] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:12.412343 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:12.536817 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddd62a1-2fd7-4e46-a47d-105b31bc7da6 None None] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:12.572833 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba10b041-cd7c-45c2-90ec-0cbd4d3203ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:12.573510 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba10b041-cd7c-45c2-90ec-0cbd4d3203ac None admin] REQUEST_METHOD: `PUT` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:12.573792 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba10b041-cd7c-45c2-90ec-0cbd4d3203ac None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:12.574081 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba10b041-cd7c-45c2-90ec-0cbd4d3203ac None admin] PATH_INFO: `/v3/projects/b86798f4dc4d4dd79428558b3d00ae1a/users/8c9a05fd5d3a475794970a2dedf5da05/roles/3a42524fc57c4487a34c5c05234413a7` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:12.575978 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba10b041-cd7c-45c2-90ec-0cbd4d3203ac None admin] RBAC: Authorizing `identity:create_grant(project_id=b86798f4dc4d4dd79428558b3d00ae1a, user_id=8c9a05fd5d3a475794970a2dedf5da05, role_id=3a42524fc57c4487a34c5c05234413a7)` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:12.577262 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211ec5d7-e29e-4ace-86ad-837cdaf63c47 None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:12.577443 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba10b041-cd7c-45c2-90ec-0cbd4d3203ac None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:12.605906 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 126/257] 10.222.0.18 () {58 vars in 1439 bytes} [Sat Sep 24 19:21:12 2022] PUT /identity/v3/projects/b86798f4dc4d4dd79428558b3d00ae1a/users/8c9a05fd5d3a475794970a2dedf5da05/roles/3a42524fc57c4487a34c5c05234413a7 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:21:12.702396 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211ec5d7-e29e-4ace-86ad-837cdaf63c47 None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:12.741077 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74c57a6-2ff2-4d5f-a627-06d12eca9d30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:12.741726 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74c57a6-2ff2-4d5f-a627-06d12eca9d30 None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:12.742033 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74c57a6-2ff2-4d5f-a627-06d12eca9d30 None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:12.742563 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74c57a6-2ff2-4d5f-a627-06d12eca9d30 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:12.754945 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74c57a6-2ff2-4d5f-a627-06d12eca9d30 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:21:12.760610 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application [None req-d74c57a6-2ff2-4d5f-a627-06d12eca9d30 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 19:21:12.760610 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:21:12.760610 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:21:12.760610 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:21:12.760610 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:21:12.760610 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:21:12.760610 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:21:12.760610 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:21:12.760610 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:21:12.760610 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:21:12.760610 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:21:12.760610 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:21:12.760610 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:21:12.760610 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:21:12.760610 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:21:12.760610 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:21:12.761479 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:21:12.761479 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:21:12.761479 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:21:12.761479 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:21:12.761479 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:21:12.761479 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:21:12.761479 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:21:12.761479 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:21:12.761479 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:21:12.761479 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:21:12.761479 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:21:12.761479 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application with Lock( Sep 24 19:21:12.761479 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:21:12.761479 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:21:12.761479 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:21:12.761479 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:21:12.762841 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:21:12.762841 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:21:12.762841 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:21:12.762841 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:21:12.762841 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:21:12.762841 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:21:12.762841 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:21:12.762841 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:21:12.762841 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:21:12.762841 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:21:12.762841 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 19:21:12.762841 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Sep 24 19:21:12.762841 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 132/258] 10.222.0.18 () {56 vars in 1096 bytes} [Sat Sep 24 19:21:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:21:12.768399 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba10b041-cd7c-45c2-90ec-0cbd4d3203ac None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:12.840257 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:12.888708 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba10b041-cd7c-45c2-90ec-0cbd4d3203ac None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:12.928397 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5912698a-436e-4a53-9d94-db01cd0bcce1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:12.929023 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5912698a-436e-4a53-9d94-db01cd0bcce1 None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:12.929272 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5912698a-436e-4a53-9d94-db01cd0bcce1 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:12.929546 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5912698a-436e-4a53-9d94-db01cd0bcce1 None admin] PATH_INFO: `/v3/roles` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:12.930320 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5912698a-436e-4a53-9d94-db01cd0bcce1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:21:12.930623 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5912698a-436e-4a53-9d94-db01cd0bcce1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:12.932010 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5912698a-436e-4a53-9d94-db01cd0bcce1 None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:12.941947 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 127/259] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Sep 24 19:21:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:21:12.947731 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74c57a6-2ff2-4d5f-a627-06d12eca9d30 None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:12.969427 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:13.019366 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5912698a-436e-4a53-9d94-db01cd0bcce1 None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:13.074251 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74c57a6-2ff2-4d5f-a627-06d12eca9d30 None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:13.124581 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5616399-ca0f-4777-b3a9-d404fac4e93e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:13.125227 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5616399-ca0f-4777-b3a9-d404fac4e93e None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:13.125509 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5616399-ca0f-4777-b3a9-d404fac4e93e None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:13.125784 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5616399-ca0f-4777-b3a9-d404fac4e93e None admin] PATH_INFO: `/v3/users/e15d6166e0bc4bf585c618e905a89a84` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:13.126973 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5616399-ca0f-4777-b3a9-d404fac4e93e None admin] RBAC: Authorizing `identity:get_user(user_id=e15d6166e0bc4bf585c618e905a89a84)` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:13.129561 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5616399-ca0f-4777-b3a9-d404fac4e93e None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:13.131784 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 133/260] 10.222.0.18 () {56 vars in 1177 bytes} [Sat Sep 24 19:21:12 2022] GET /identity/v3/users/e15d6166e0bc4bf585c618e905a89a84 => generated 283 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:21:13.138475 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5616399-ca0f-4777-b3a9-d404fac4e93e None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:13.164090 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5912698a-436e-4a53-9d94-db01cd0bcce1 None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:13.194294 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:13.204485 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98880077-4502-4150-93e8-5006db6316c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:13.205441 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98880077-4502-4150-93e8-5006db6316c9 None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:13.205949 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98880077-4502-4150-93e8-5006db6316c9 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:13.206443 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98880077-4502-4150-93e8-5006db6316c9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:13.219311 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98880077-4502-4150-93e8-5006db6316c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:21:13.225985 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application [None req-98880077-4502-4150-93e8-5006db6316c9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 24 19:21:13.225985 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:21:13.225985 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:21:13.225985 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:21:13.225985 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:21:13.225985 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:21:13.225985 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:21:13.225985 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:21:13.225985 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:21:13.225985 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:21:13.225985 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:21:13.225985 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:21:13.225985 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:21:13.225985 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:21:13.225985 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:21:13.225985 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:21:13.227002 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:21:13.227002 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:21:13.227002 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:21:13.227002 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:21:13.227002 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:21:13.227002 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:21:13.227002 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:21:13.227002 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:21:13.227002 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:21:13.227002 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:21:13.227002 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:21:13.227002 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application with Lock( Sep 24 19:21:13.227002 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:21:13.227002 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:21:13.227002 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:21:13.227002 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:21:13.227778 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:21:13.227778 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:21:13.227778 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:21:13.227778 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:21:13.227778 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:21:13.227778 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:21:13.227778 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:21:13.227778 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:21:13.227778 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:21:13.227778 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:21:13.227778 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 24 19:21:13.227778 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Sep 24 19:21:13.230206 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 128/261] 10.222.0.18 () {56 vars in 1114 bytes} [Sat Sep 24 19:21:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 19:21:13.243887 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98880077-4502-4150-93e8-5006db6316c9 None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:13.278192 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:13.296994 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5616399-ca0f-4777-b3a9-d404fac4e93e None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:13.362041 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0ea0a6-ff0b-476b-aeb5-e09351c3c7ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:13.362665 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0ea0a6-ff0b-476b-aeb5-e09351c3c7ee None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:13.362946 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0ea0a6-ff0b-476b-aeb5-e09351c3c7ee None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:13.364039 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0ea0a6-ff0b-476b-aeb5-e09351c3c7ee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:13.427875 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98880077-4502-4150-93e8-5006db6316c9 None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:13.491949 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4bdbf6-9d10-4836-9c93-6309d7723ac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:13.492823 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4bdbf6-9d10-4836-9c93-6309d7723ac7 None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:13.493565 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4bdbf6-9d10-4836-9c93-6309d7723ac7 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:13.493853 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4bdbf6-9d10-4836-9c93-6309d7723ac7 None admin] PATH_INFO: `/v3/roles` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:13.494536 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4bdbf6-9d10-4836-9c93-6309d7723ac7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:21:13.494835 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4bdbf6-9d10-4836-9c93-6309d7723ac7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:13.496210 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4bdbf6-9d10-4836-9c93-6309d7723ac7 None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:13.499643 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0ea0a6-ff0b-476b-aeb5-e09351c3c7ee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:13.501100 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0ea0a6-ff0b-476b-aeb5-e09351c3c7ee None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:13.518765 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 129/262] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Sep 24 19:21:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:21:13.537920 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4bdbf6-9d10-4836-9c93-6309d7723ac7 None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:13.649756 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:13.713314 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:13.736636 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 134/263] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Sep 24 19:21:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 599 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 24 19:21:13.746852 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0ea0a6-ff0b-476b-aeb5-e09351c3c7ee None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:13.762003 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4bdbf6-9d10-4836-9c93-6309d7723ac7 None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:13.849016 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407992a3-2f83-43d9-9a85-8ec618513e3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:13.849756 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407992a3-2f83-43d9-9a85-8ec618513e3e None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:13.850166 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407992a3-2f83-43d9-9a85-8ec618513e3e None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:13.850443 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407992a3-2f83-43d9-9a85-8ec618513e3e None admin] PATH_INFO: `/v3/users/e15d6166e0bc4bf585c618e905a89a84` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:13.853117 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407992a3-2f83-43d9-9a85-8ec618513e3e None admin] RBAC: Authorizing `identity:get_user(user_id=e15d6166e0bc4bf585c618e905a89a84)` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:13.855247 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407992a3-2f83-43d9-9a85-8ec618513e3e None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:13.857062 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 130/264] 10.222.0.18 () {56 vars in 1177 bytes} [Sat Sep 24 19:21:13 2022] GET /identity/v3/users/e15d6166e0bc4bf585c618e905a89a84 => generated 283 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:21:13.863425 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407992a3-2f83-43d9-9a85-8ec618513e3e None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:13.928128 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0ea0a6-ff0b-476b-aeb5-e09351c3c7ee None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:14.019717 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2f6a2a-9cf9-4206-b3e4-8843fd01a63f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:14.020323 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2f6a2a-9cf9-4206-b3e4-8843fd01a63f None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:14.020581 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2f6a2a-9cf9-4206-b3e4-8843fd01a63f None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:14.021050 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2f6a2a-9cf9-4206-b3e4-8843fd01a63f None admin] PATH_INFO: `/v3/projects/b86798f4dc4d4dd79428558b3d00ae1a` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:14.022392 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2f6a2a-9cf9-4206-b3e4-8843fd01a63f None admin] RBAC: Authorizing `identity:get_project(project_id=b86798f4dc4d4dd79428558b3d00ae1a)` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:14.023998 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2f6a2a-9cf9-4206-b3e4-8843fd01a63f None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:14.030059 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 135/265] 10.222.0.18 () {56 vars in 1186 bytes} [Sat Sep 24 19:21:13 2022] GET /identity/v3/projects/b86798f4dc4d4dd79428558b3d00ae1a => generated 302 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:21:14.032470 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2f6a2a-9cf9-4206-b3e4-8843fd01a63f None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:14.065688 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407992a3-2f83-43d9-9a85-8ec618513e3e None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:14.108313 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:14.138164 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:14.160018 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080d2907-c55a-40fd-b547-7bb8760320ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:14.160683 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080d2907-c55a-40fd-b547-7bb8760320ef None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:14.160980 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080d2907-c55a-40fd-b547-7bb8760320ef None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:14.161235 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080d2907-c55a-40fd-b547-7bb8760320ef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:14.241231 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2f6a2a-9cf9-4206-b3e4-8843fd01a63f None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:14.287696 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080d2907-c55a-40fd-b547-7bb8760320ef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:14.289128 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080d2907-c55a-40fd-b547-7bb8760320ef None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:14.323742 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d068b037-af7a-4c3d-bd14-2761358a06f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:14.324359 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d068b037-af7a-4c3d-bd14-2761358a06f6 None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:14.324632 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d068b037-af7a-4c3d-bd14-2761358a06f6 None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:14.324902 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d068b037-af7a-4c3d-bd14-2761358a06f6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:14.325634 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d068b037-af7a-4c3d-bd14-2761358a06f6 None admin] RBAC: Adding query filter params (role.id=4c7d0dafc19b4b0a9821be6ec0da0a8f, scope.project.id=b86798f4dc4d4dd79428558b3d00ae1a, user.id=e15d6166e0bc4bf585c618e905a89a84) {{(pid=88080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:21:14.325962 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d068b037-af7a-4c3d-bd14-2761358a06f6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:14.327428 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d068b037-af7a-4c3d-bd14-2761358a06f6 None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:14.335001 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 136/266] 10.222.0.18 () {56 vars in 1374 bytes} [Sat Sep 24 19:21:14 2022] GET /identity/v3/role_assignments?user.id=e15d6166e0bc4bf585c618e905a89a84&scope.project.id=b86798f4dc4d4dd79428558b3d00ae1a&role.id=4c7d0dafc19b4b0a9821be6ec0da0a8f => generated 608 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:21:14.471111 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 131/267] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Sep 24 19:21:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 609 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 24 19:21:14.476742 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d068b037-af7a-4c3d-bd14-2761358a06f6 None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:14.678829 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d068b037-af7a-4c3d-bd14-2761358a06f6 None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:14.703798 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:14.717217 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da80034-da24-43a1-954c-7df5935b5479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:14.718195 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da80034-da24-43a1-954c-7df5935b5479 None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:14.718674 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da80034-da24-43a1-954c-7df5935b5479 None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:14.719126 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da80034-da24-43a1-954c-7df5935b5479 None admin] PATH_INFO: `/v3/projects/b86798f4dc4d4dd79428558b3d00ae1a` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:14.720478 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da80034-da24-43a1-954c-7df5935b5479 None admin] RBAC: Authorizing `identity:get_project(project_id=b86798f4dc4d4dd79428558b3d00ae1a)` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:14.722355 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da80034-da24-43a1-954c-7df5935b5479 None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:14.724651 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 137/268] 10.222.0.18 () {56 vars in 1186 bytes} [Sat Sep 24 19:21:14 2022] GET /identity/v3/projects/b86798f4dc4d4dd79428558b3d00ae1a => generated 302 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:21:14.730404 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080d2907-c55a-40fd-b547-7bb8760320ef None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:14.768874 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:14.900739 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080d2907-c55a-40fd-b547-7bb8760320ef None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:14.954655 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fd7728-713b-4792-bcd4-cb3da65c753a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:14.955198 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fd7728-713b-4792-bcd4-cb3da65c753a None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:14.955476 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fd7728-713b-4792-bcd4-cb3da65c753a None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:14.955749 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fd7728-713b-4792-bcd4-cb3da65c753a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:14.956484 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fd7728-713b-4792-bcd4-cb3da65c753a None admin] RBAC: Adding query filter params (role.id=a24280fb630f4c17865458d833144b17, scope.project.id=b86798f4dc4d4dd79428558b3d00ae1a, user.id=e15d6166e0bc4bf585c618e905a89a84) {{(pid=88081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:21:14.957358 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fd7728-713b-4792-bcd4-cb3da65c753a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:14.958816 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fd7728-713b-4792-bcd4-cb3da65c753a None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:14.965285 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 132/269] 10.222.0.18 () {56 vars in 1374 bytes} [Sat Sep 24 19:21:14 2022] GET /identity/v3/role_assignments?user.id=e15d6166e0bc4bf585c618e905a89a84&scope.project.id=b86798f4dc4d4dd79428558b3d00ae1a&role.id=a24280fb630f4c17865458d833144b17 => generated 608 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:21:14.975874 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3386c2ad-5c8d-4d09-becf-75131338d435 None None] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:14.976491 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3386c2ad-5c8d-4d09-becf-75131338d435 None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:14.976956 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3386c2ad-5c8d-4d09-becf-75131338d435 None None] PATH_INFO: `/` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:14.978632 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 138/270] 10.222.0.18 () {54 vars in 927 bytes} [Sat Sep 24 19:21:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:21:14.992973 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aa71fe-726b-4053-a69a-60d7ead877c7 None None] REQUEST_METHOD: `POST` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:14.993302 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aa71fe-726b-4053-a69a-60d7ead877c7 None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:14.993521 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aa71fe-726b-4053-a69a-60d7ead877c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:15.014840 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.auth.core [None req-c6aa71fe-726b-4053-a69a-60d7ead877c7 None None] MFA Rules not processed for user `3dbbb9909cec43ff99c1c3682f016ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=88081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:21:15.016051 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.fernet_utils [None req-c6aa71fe-726b-4053-a69a-60d7ead877c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:21:15.103863 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 133/271] 10.222.0.18 () {58 vars in 1024 bytes} [Sat Sep 24 19:21:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 24 19:21:15.291708 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2af579-f2d9-446b-93c2-f17a98ed16c1 None None] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:15.291708 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2af579-f2d9-446b-93c2-f17a98ed16c1 None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:15.291708 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2af579-f2d9-446b-93c2-f17a98ed16c1 None None] PATH_INFO: `/` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:15.291708 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 139/272] 10.222.0.18 () {54 vars in 927 bytes} [Sat Sep 24 19:21:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:21:15.299093 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f91bf9-4053-48e2-af2e-237911d7a5d4 None None] REQUEST_METHOD: `POST` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:15.299736 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f91bf9-4053-48e2-af2e-237911d7a5d4 None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:15.300210 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f91bf9-4053-48e2-af2e-237911d7a5d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:15.321110 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.auth.core [None req-78f91bf9-4053-48e2-af2e-237911d7a5d4 None None] MFA Rules not processed for user `3dbbb9909cec43ff99c1c3682f016ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=88081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:21:15.323621 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.fernet_utils [None req-78f91bf9-4053-48e2-af2e-237911d7a5d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:21:15.327326 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:15.406488 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 134/273] 10.222.0.18 () {58 vars in 1024 bytes} [Sat Sep 24 19:21:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:21:15.553113 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2af579-f2d9-446b-93c2-f17a98ed16c1 None None] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:15.683907 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2af579-f2d9-446b-93c2-f17a98ed16c1 None None] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:15.724983 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a2b576-4cf8-4bc3-834f-7eab5e38831b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:15.725615 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a2b576-4cf8-4bc3-834f-7eab5e38831b None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:15.725933 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a2b576-4cf8-4bc3-834f-7eab5e38831b None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:15.726207 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a2b576-4cf8-4bc3-834f-7eab5e38831b None admin] PATH_INFO: `/v3/roles/member` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:15.731239 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d3916e-ae5f-420e-8763-28a4dfbcde18 None None] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:15.731928 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d3916e-ae5f-420e-8763-28a4dfbcde18 None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:15.732390 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d3916e-ae5f-420e-8763-28a4dfbcde18 None None] PATH_INFO: `/` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:15.733999 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 135/274] 10.222.0.18 () {54 vars in 927 bytes} [Sat Sep 24 19:21:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 24 19:21:15.738165 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a2b576-4cf8-4bc3-834f-7eab5e38831b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:21:15.739550 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0303bf-4001-4004-bd4d-ab52bb063179 None None] REQUEST_METHOD: `POST` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:15.740026 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0303bf-4001-4004-bd4d-ab52bb063179 None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:15.740487 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0303bf-4001-4004-bd4d-ab52bb063179 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:15.743291 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application [None req-f4a2b576-4cf8-4bc3-834f-7eab5e38831b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 24 19:21:15.743291 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:21:15.743291 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:21:15.743291 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:21:15.743291 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:21:15.743291 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:21:15.743291 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:21:15.743291 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:21:15.743291 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:21:15.743291 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:21:15.743291 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:21:15.743291 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:21:15.743291 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:21:15.743291 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:21:15.743291 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:21:15.743291 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:21:15.744159 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:21:15.744159 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:21:15.744159 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:21:15.744159 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:21:15.744159 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:21:15.744159 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:21:15.744159 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:21:15.744159 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:21:15.744159 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:21:15.744159 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:21:15.744159 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:21:15.744159 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application with Lock( Sep 24 19:21:15.744159 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:21:15.744159 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:21:15.744159 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:21:15.744159 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:21:15.744955 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:21:15.744955 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:21:15.744955 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:21:15.744955 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:21:15.744955 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:21:15.744955 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:21:15.744955 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:21:15.744955 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:21:15.744955 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:21:15.744955 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:21:15.744955 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 24 19:21:15.744955 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Sep 24 19:21:15.744955 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 140/275] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Sep 24 19:21:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:21:15.748050 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a2b576-4cf8-4bc3-834f-7eab5e38831b None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:15.763556 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.auth.core [None req-ff0303bf-4001-4004-bd4d-ab52bb063179 None None] MFA Rules not processed for user `3dbbb9909cec43ff99c1c3682f016ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=88081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:21:15.764720 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.fernet_utils [None req-ff0303bf-4001-4004-bd4d-ab52bb063179 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:21:15.800609 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:15.841257 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 136/276] 10.222.0.18 () {58 vars in 1024 bytes} [Sat Sep 24 19:21:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:21:15.850804 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0303bf-4001-4004-bd4d-ab52bb063179 None None] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:15.862719 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a2b576-4cf8-4bc3-834f-7eab5e38831b None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:15.901182 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32914e37-5254-4059-b299-f701e9bde68f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:15.902130 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32914e37-5254-4059-b299-f701e9bde68f None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:15.902558 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32914e37-5254-4059-b299-f701e9bde68f None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:15.903073 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32914e37-5254-4059-b299-f701e9bde68f None admin] PATH_INFO: `/v3/domains/default` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:15.904394 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32914e37-5254-4059-b299-f701e9bde68f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:15.906090 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32914e37-5254-4059-b299-f701e9bde68f None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:15.907930 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 141/277] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Sep 24 19:21:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:21:15.914489 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32914e37-5254-4059-b299-f701e9bde68f None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:15.950060 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:15.986426 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0303bf-4001-4004-bd4d-ab52bb063179 None None] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:16.025152 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317fcbed-9aaa-4c01-ac3f-cc46ead224fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:16.026081 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317fcbed-9aaa-4c01-ac3f-cc46ead224fb None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:16.026508 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317fcbed-9aaa-4c01-ac3f-cc46ead224fb None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:16.026965 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317fcbed-9aaa-4c01-ac3f-cc46ead224fb None admin] PATH_INFO: `/v3/roles` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:16.028093 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317fcbed-9aaa-4c01-ac3f-cc46ead224fb None admin] RBAC: Adding query filter params (name=member) {{(pid=88081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:21:16.028581 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317fcbed-9aaa-4c01-ac3f-cc46ead224fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:16.030335 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317fcbed-9aaa-4c01-ac3f-cc46ead224fb None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:16.039560 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 137/278] 10.222.0.18 () {56 vars in 1101 bytes} [Sat Sep 24 19:21:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:21:16.045154 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317fcbed-9aaa-4c01-ac3f-cc46ead224fb None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:16.054159 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32914e37-5254-4059-b299-f701e9bde68f None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:16.072566 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:16.103921 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd630bdb-99b9-44bc-91e9-03f06dc513f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:16.104651 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd630bdb-99b9-44bc-91e9-03f06dc513f3 None admin] REQUEST_METHOD: `POST` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:16.104930 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd630bdb-99b9-44bc-91e9-03f06dc513f3 None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:16.105203 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd630bdb-99b9-44bc-91e9-03f06dc513f3 None admin] PATH_INFO: `/v3/users` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:16.105875 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd630bdb-99b9-44bc-91e9-03f06dc513f3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:16.108067 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd630bdb-99b9-44bc-91e9-03f06dc513f3 None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:16.137641 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 142/279] 10.222.0.18 () {60 vars in 1132 bytes} [Sat Sep 24 19:21:15 2022] POST /identity/v3/users => generated 293 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:21:16.138929 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8acd85-b4ed-40b2-9054-c7f7cef89a34 None None] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:16.139241 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8acd85-b4ed-40b2-9054-c7f7cef89a34 None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:16.139486 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8acd85-b4ed-40b2-9054-c7f7cef89a34 None None] PATH_INFO: `/` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:16.141225 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 143/280] 10.222.0.18 () {54 vars in 927 bytes} [Sat Sep 24 19:21:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:21:16.151831 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8d85c7-5809-4e87-b917-858142810aff None None] REQUEST_METHOD: `POST` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:16.152513 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8d85c7-5809-4e87-b917-858142810aff None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:16.152989 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8d85c7-5809-4e87-b917-858142810aff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:16.173813 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.auth.core [None req-ba8d85c7-5809-4e87-b917-858142810aff None None] MFA Rules not processed for user `3dbbb9909cec43ff99c1c3682f016ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=88080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:21:16.174205 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317fcbed-9aaa-4c01-ac3f-cc46ead224fb None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:16.175072 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.fernet_utils [None req-ba8d85c7-5809-4e87-b917-858142810aff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:21:16.208382 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:16.215456 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d169f91-963a-4bd8-b70f-120963398611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:16.216845 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d169f91-963a-4bd8-b70f-120963398611 None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:16.217577 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d169f91-963a-4bd8-b70f-120963398611 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:16.217874 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d169f91-963a-4bd8-b70f-120963398611 None admin] PATH_INFO: `/v3/users/fd19cb7c73794d30aad0f14840c0a050` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:16.233688 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d169f91-963a-4bd8-b70f-120963398611 None admin] RBAC: Authorizing `identity:get_user(user_id=fd19cb7c73794d30aad0f14840c0a050)` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:16.235284 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d169f91-963a-4bd8-b70f-120963398611 None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:16.237138 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 138/281] 10.222.0.18 () {56 vars in 1177 bytes} [Sat Sep 24 19:21:16 2022] GET /identity/v3/users/fd19cb7c73794d30aad0f14840c0a050 => generated 293 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:21:16.238336 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d169f91-963a-4bd8-b70f-120963398611 None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:16.264815 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 144/282] 10.222.0.18 () {58 vars in 1024 bytes} [Sat Sep 24 19:21:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 24 19:21:16.265816 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8d85c7-5809-4e87-b917-858142810aff None None] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:16.379293 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d169f91-963a-4bd8-b70f-120963398611 None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:16.414126 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:16.417784 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8d85c7-5809-4e87-b917-858142810aff None None] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:16.427073 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff9b74a-fd0f-4e06-b2d9-07c15b301b8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:16.427710 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff9b74a-fd0f-4e06-b2d9-07c15b301b8a None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:16.427984 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff9b74a-fd0f-4e06-b2d9-07c15b301b8a None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:16.428250 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff9b74a-fd0f-4e06-b2d9-07c15b301b8a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:16.442930 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff9b74a-fd0f-4e06-b2d9-07c15b301b8a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:21:16.450023 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application [None req-1ff9b74a-fd0f-4e06-b2d9-07c15b301b8a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 24 19:21:16.450023 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:21:16.450023 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:21:16.450023 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:21:16.450023 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:21:16.450023 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:21:16.450023 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:21:16.450023 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:21:16.450023 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:21:16.450023 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:21:16.450023 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:21:16.450023 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:21:16.450023 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:21:16.450023 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:21:16.450023 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:21:16.450023 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:21:16.450975 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:21:16.450975 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:21:16.450975 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:21:16.450975 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:21:16.450975 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:21:16.450975 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:21:16.450975 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:21:16.450975 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:21:16.450975 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:21:16.450975 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:21:16.450975 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:21:16.450975 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application with Lock( Sep 24 19:21:16.450975 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:21:16.450975 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:21:16.450975 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:21:16.450975 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:21:16.451787 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:21:16.451787 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:21:16.451787 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:21:16.451787 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:21:16.451787 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:21:16.451787 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:21:16.451787 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:21:16.451787 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:21:16.451787 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:21:16.451787 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:21:16.451787 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 24 19:21:16.451787 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Sep 24 19:21:16.454913 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 139/283] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Sep 24 19:21:16 2022] GET /identity/v3/roles/reader => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:21:16.460680 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff9b74a-fd0f-4e06-b2d9-07c15b301b8a None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:16.465478 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df806f4-ba8d-4fc2-b685-d723d2907493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:16.466207 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df806f4-ba8d-4fc2-b685-d723d2907493 None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:16.466592 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df806f4-ba8d-4fc2-b685-d723d2907493 None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:16.466928 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df806f4-ba8d-4fc2-b685-d723d2907493 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:16.467772 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df806f4-ba8d-4fc2-b685-d723d2907493 None admin] RBAC: Adding query filter params (role.id=3a42524fc57c4487a34c5c05234413a7, user.id=fd19cb7c73794d30aad0f14840c0a050, scope.system=all) {{(pid=88080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:21:16.468074 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df806f4-ba8d-4fc2-b685-d723d2907493 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:16.469514 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df806f4-ba8d-4fc2-b685-d723d2907493 None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:16.476867 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 145/284] 10.222.0.18 () {56 vars in 1308 bytes} [Sat Sep 24 19:21:16 2022] GET /identity/v3/role_assignments?user.id=fd19cb7c73794d30aad0f14840c0a050&scope.system=all&role.id=3a42524fc57c4487a34c5c05234413a7 => generated 226 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:21:16.526093 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:16.594540 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff9b74a-fd0f-4e06-b2d9-07c15b301b8a None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:16.602610 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df806f4-ba8d-4fc2-b685-d723d2907493 None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:16.649302 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816eba28-b669-4fce-8ac0-0454e5abde6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:16.650502 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816eba28-b669-4fce-8ac0-0454e5abde6f None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:16.650993 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816eba28-b669-4fce-8ac0-0454e5abde6f None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:16.651484 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816eba28-b669-4fce-8ac0-0454e5abde6f None admin] PATH_INFO: `/v3/roles` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:16.652369 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816eba28-b669-4fce-8ac0-0454e5abde6f None admin] RBAC: Adding query filter params (name=reader) {{(pid=88081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:21:16.652875 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816eba28-b669-4fce-8ac0-0454e5abde6f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:16.654549 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816eba28-b669-4fce-8ac0-0454e5abde6f None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:16.668031 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 140/285] 10.222.0.18 () {56 vars in 1101 bytes} [Sat Sep 24 19:21:16 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:21:16.674242 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816eba28-b669-4fce-8ac0-0454e5abde6f None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:16.759792 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df806f4-ba8d-4fc2-b685-d723d2907493 None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:16.803490 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3c3e82-b321-4a29-a4e1-c1637657d123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:16.804319 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3c3e82-b321-4a29-a4e1-c1637657d123 None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:16.804429 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3c3e82-b321-4a29-a4e1-c1637657d123 None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:16.804643 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3c3e82-b321-4a29-a4e1-c1637657d123 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:16.815349 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3c3e82-b321-4a29-a4e1-c1637657d123 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:21:16.818472 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816eba28-b669-4fce-8ac0-0454e5abde6f None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:16.820715 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application [None req-6b3c3e82-b321-4a29-a4e1-c1637657d123 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 24 19:21:16.820715 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:21:16.820715 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:21:16.820715 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:21:16.820715 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:21:16.820715 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:21:16.820715 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:21:16.820715 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:21:16.820715 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:21:16.820715 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:21:16.820715 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:21:16.820715 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:21:16.820715 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:21:16.820715 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:21:16.820715 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:21:16.820715 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:21:16.821625 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:21:16.821625 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:21:16.821625 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:21:16.821625 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:21:16.821625 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:21:16.821625 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:21:16.821625 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:21:16.821625 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:21:16.821625 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:21:16.821625 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:21:16.821625 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:21:16.821625 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application with Lock( Sep 24 19:21:16.821625 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:21:16.821625 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:21:16.821625 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:21:16.821625 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:21:16.826397 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:21:16.826397 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:21:16.826397 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:21:16.826397 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:21:16.826397 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:21:16.826397 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:21:16.826397 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:21:16.826397 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:21:16.826397 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:21:16.826397 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:21:16.826397 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 24 19:21:16.826397 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Sep 24 19:21:16.826397 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 146/286] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Sep 24 19:21:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:21:16.832661 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3c3e82-b321-4a29-a4e1-c1637657d123 None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:16.851554 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:16.879802 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:16.892690 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f337068-69e7-461b-ab29-dfd622e8c747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:16.894360 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f337068-69e7-461b-ab29-dfd622e8c747 None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:16.894646 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f337068-69e7-461b-ab29-dfd622e8c747 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:16.894917 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f337068-69e7-461b-ab29-dfd622e8c747 None admin] PATH_INFO: `/v3/users/d2653aeb65964617a83dd1b899f8a540` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:16.898040 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f337068-69e7-461b-ab29-dfd622e8c747 None admin] RBAC: Authorizing `identity:get_user(user_id=d2653aeb65964617a83dd1b899f8a540)` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:16.900471 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f337068-69e7-461b-ab29-dfd622e8c747 None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:16.902326 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 141/287] 10.222.0.18 () {56 vars in 1177 bytes} [Sat Sep 24 19:21:16 2022] GET /identity/v3/users/d2653aeb65964617a83dd1b899f8a540 => generated 297 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:21:16.907941 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f337068-69e7-461b-ab29-dfd622e8c747 None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:17.034171 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3c3e82-b321-4a29-a4e1-c1637657d123 None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:17.095249 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f337068-69e7-461b-ab29-dfd622e8c747 None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:17.102579 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d470a7f-7546-4570-a2df-8081193b5392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:17.103214 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d470a7f-7546-4570-a2df-8081193b5392 None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:17.103479 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d470a7f-7546-4570-a2df-8081193b5392 None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:17.103754 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d470a7f-7546-4570-a2df-8081193b5392 None admin] PATH_INFO: `/v3/roles` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:17.104434 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d470a7f-7546-4570-a2df-8081193b5392 None admin] RBAC: Adding query filter params (name=member) {{(pid=88080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:21:17.104739 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d470a7f-7546-4570-a2df-8081193b5392 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:17.110211 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d470a7f-7546-4570-a2df-8081193b5392 None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:17.120501 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 147/288] 10.222.0.18 () {56 vars in 1101 bytes} [Sat Sep 24 19:21:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:21:17.125851 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d470a7f-7546-4570-a2df-8081193b5392 None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:17.156688 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a59df6-0953-448e-aecd-eb350fab8ed8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:17.157249 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a59df6-0953-448e-aecd-eb350fab8ed8 None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:17.157524 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a59df6-0953-448e-aecd-eb350fab8ed8 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:17.157796 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a59df6-0953-448e-aecd-eb350fab8ed8 None admin] PATH_INFO: `/v3/projects/b86798f4dc4d4dd79428558b3d00ae1a` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:17.166426 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a59df6-0953-448e-aecd-eb350fab8ed8 None admin] RBAC: Authorizing `identity:get_project(project_id=b86798f4dc4d4dd79428558b3d00ae1a)` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:17.166426 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a59df6-0953-448e-aecd-eb350fab8ed8 None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:17.166426 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 142/289] 10.222.0.18 () {56 vars in 1186 bytes} [Sat Sep 24 19:21:16 2022] GET /identity/v3/projects/b86798f4dc4d4dd79428558b3d00ae1a => generated 302 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:21:17.170957 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a59df6-0953-448e-aecd-eb350fab8ed8 None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:17.250366 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:17.264881 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:17.300009 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d470a7f-7546-4570-a2df-8081193b5392 None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:17.321335 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a59df6-0953-448e-aecd-eb350fab8ed8 None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:17.349895 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498b9b76-f63a-45db-a782-c81449c02aca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:17.350926 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498b9b76-f63a-45db-a782-c81449c02aca None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:17.351383 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498b9b76-f63a-45db-a782-c81449c02aca None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:17.351847 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498b9b76-f63a-45db-a782-c81449c02aca None admin] PATH_INFO: `/v3/users/8c9a05fd5d3a475794970a2dedf5da05` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:17.353205 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498b9b76-f63a-45db-a782-c81449c02aca None admin] RBAC: Authorizing `identity:get_user(user_id=8c9a05fd5d3a475794970a2dedf5da05)` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:17.354844 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498b9b76-f63a-45db-a782-c81449c02aca None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:17.356623 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 148/290] 10.222.0.18 () {56 vars in 1177 bytes} [Sat Sep 24 19:21:17 2022] GET /identity/v3/users/8c9a05fd5d3a475794970a2dedf5da05 => generated 297 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:21:17.361967 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f722a9-4df5-4ba9-b398-610929842031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:17.362554 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498b9b76-f63a-45db-a782-c81449c02aca None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:17.363402 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f722a9-4df5-4ba9-b398-610929842031 None admin] REQUEST_METHOD: `PUT` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:17.363757 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f722a9-4df5-4ba9-b398-610929842031 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:17.364087 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f722a9-4df5-4ba9-b398-610929842031 None admin] PATH_INFO: `/v3/projects/b86798f4dc4d4dd79428558b3d00ae1a/users/d2653aeb65964617a83dd1b899f8a540/roles/f072ea6ff7ca4dbf90174c318d19acf1` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:17.366098 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f722a9-4df5-4ba9-b398-610929842031 None admin] RBAC: Authorizing `identity:create_grant(project_id=b86798f4dc4d4dd79428558b3d00ae1a, user_id=d2653aeb65964617a83dd1b899f8a540, role_id=f072ea6ff7ca4dbf90174c318d19acf1)` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:17.369191 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f722a9-4df5-4ba9-b398-610929842031 None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:17.393443 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 143/291] 10.222.0.18 () {58 vars in 1439 bytes} [Sat Sep 24 19:21:17 2022] PUT /identity/v3/projects/b86798f4dc4d4dd79428558b3d00ae1a/users/d2653aeb65964617a83dd1b899f8a540/roles/f072ea6ff7ca4dbf90174c318d19acf1 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 24 19:21:17.490705 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498b9b76-f63a-45db-a782-c81449c02aca None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:17.528575 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f645d7f-780e-4050-ab56-2c4e76256a3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:17.529192 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f645d7f-780e-4050-ab56-2c4e76256a3f None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:17.529467 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f645d7f-780e-4050-ab56-2c4e76256a3f None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:17.529738 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f645d7f-780e-4050-ab56-2c4e76256a3f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:17.554219 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:17.606595 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f645d7f-780e-4050-ab56-2c4e76256a3f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:17.608066 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f645d7f-780e-4050-ab56-2c4e76256a3f None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:17.718413 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 149/292] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Sep 24 19:21:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 24 19:21:17.724703 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f722a9-4df5-4ba9-b398-610929842031 None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:17.844201 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f722a9-4df5-4ba9-b398-610929842031 None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:17.854115 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:17.895292 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d75e4b-0f06-4a29-861d-e14ac81e73e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:17.895932 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d75e4b-0f06-4a29-861d-e14ac81e73e8 None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:17.896268 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d75e4b-0f06-4a29-861d-e14ac81e73e8 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:17.896539 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d75e4b-0f06-4a29-861d-e14ac81e73e8 None admin] PATH_INFO: `/v3/projects/b86798f4dc4d4dd79428558b3d00ae1a` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:17.899350 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d75e4b-0f06-4a29-861d-e14ac81e73e8 None admin] RBAC: Authorizing `identity:get_project(project_id=b86798f4dc4d4dd79428558b3d00ae1a)` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:17.900835 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d75e4b-0f06-4a29-861d-e14ac81e73e8 None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:17.902512 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 144/293] 10.222.0.18 () {56 vars in 1186 bytes} [Sat Sep 24 19:21:17 2022] GET /identity/v3/projects/b86798f4dc4d4dd79428558b3d00ae1a => generated 302 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:21:17.908406 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f645d7f-780e-4050-ab56-2c4e76256a3f None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:17.988519 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:18.053551 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f645d7f-780e-4050-ab56-2c4e76256a3f None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:18.109960 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6840301f-8b47-4e30-83ac-b6bcda117488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:18.110955 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6840301f-8b47-4e30-83ac-b6bcda117488 None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:18.111441 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6840301f-8b47-4e30-83ac-b6bcda117488 None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:18.111930 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6840301f-8b47-4e30-83ac-b6bcda117488 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:18.113211 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6840301f-8b47-4e30-83ac-b6bcda117488 None admin] RBAC: Adding query filter params (role.id=3a42524fc57c4487a34c5c05234413a7, scope.project.id=b86798f4dc4d4dd79428558b3d00ae1a, user.id=8c9a05fd5d3a475794970a2dedf5da05) {{(pid=88080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:21:18.113730 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6840301f-8b47-4e30-83ac-b6bcda117488 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:18.115425 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6840301f-8b47-4e30-83ac-b6bcda117488 None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:18.126459 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 150/294] 10.222.0.18 () {56 vars in 1374 bytes} [Sat Sep 24 19:21:17 2022] GET /identity/v3/role_assignments?user.id=8c9a05fd5d3a475794970a2dedf5da05&scope.project.id=b86798f4dc4d4dd79428558b3d00ae1a&role.id=3a42524fc57c4487a34c5c05234413a7 => generated 608 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:21:19.282375 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72843be-3e21-48d0-b25d-6be1999b51f3 None None] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:19.282889 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72843be-3e21-48d0-b25d-6be1999b51f3 None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:19.282998 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72843be-3e21-48d0-b25d-6be1999b51f3 None None] PATH_INFO: `/` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:19.284608 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 145/295] 10.222.0.18 () {54 vars in 927 bytes} [Sat Sep 24 19:21:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:21:19.290236 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f512fe-85d8-45c1-b975-2a31890f68d9 None None] REQUEST_METHOD: `POST` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:19.290775 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f512fe-85d8-45c1-b975-2a31890f68d9 None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:19.291170 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f512fe-85d8-45c1-b975-2a31890f68d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:19.293654 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec2a6b6-4104-441a-ac65-1eb5c33e81d6 None None] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:19.294016 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec2a6b6-4104-441a-ac65-1eb5c33e81d6 None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:19.294287 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec2a6b6-4104-441a-ac65-1eb5c33e81d6 None None] PATH_INFO: `/` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:19.296577 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 146/296] 10.222.0.18 () {54 vars in 927 bytes} [Sat Sep 24 19:21:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:21:19.302273 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05116249-932c-4a1a-aa3a-f94fc38bb9d5 None None] REQUEST_METHOD: `POST` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:19.302273 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05116249-932c-4a1a-aa3a-f94fc38bb9d5 None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:19.302572 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05116249-932c-4a1a-aa3a-f94fc38bb9d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:19.320032 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.auth.core [None req-d3f512fe-85d8-45c1-b975-2a31890f68d9 None None] MFA Rules not processed for user `3dbbb9909cec43ff99c1c3682f016ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=88080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:21:19.321546 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.fernet_utils [None req-d3f512fe-85d8-45c1-b975-2a31890f68d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:21:19.330743 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.auth.core [None req-05116249-932c-4a1a-aa3a-f94fc38bb9d5 None None] MFA Rules not processed for user `3dbbb9909cec43ff99c1c3682f016ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=88081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:21:19.333147 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.fernet_utils [None req-05116249-932c-4a1a-aa3a-f94fc38bb9d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:21:19.408647 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 151/297] 10.222.0.18 () {58 vars in 1024 bytes} [Sat Sep 24 19:21:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:21:19.410135 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d0ec51-9a32-4f36-9494-4cf2f7edf3e2 None None] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:19.410401 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d0ec51-9a32-4f36-9494-4cf2f7edf3e2 None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:19.410741 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d0ec51-9a32-4f36-9494-4cf2f7edf3e2 None None] PATH_INFO: `/` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:19.411912 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 152/298] 10.222.0.18 () {54 vars in 927 bytes} [Sat Sep 24 19:21:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:21:19.419566 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57ae4ec-3e52-4257-ba4c-1071b4671444 None None] REQUEST_METHOD: `POST` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:19.419970 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57ae4ec-3e52-4257-ba4c-1071b4671444 None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:19.420347 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57ae4ec-3e52-4257-ba4c-1071b4671444 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:19.423966 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 147/299] 10.222.0.18 () {58 vars in 1024 bytes} [Sat Sep 24 19:21:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:21:19.441894 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.auth.core [None req-f57ae4ec-3e52-4257-ba4c-1071b4671444 None None] MFA Rules not processed for user `3dbbb9909cec43ff99c1c3682f016ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=88080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:21:19.443245 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.fernet_utils [None req-f57ae4ec-3e52-4257-ba4c-1071b4671444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:21:19.519257 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:19.556078 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 153/300] 10.222.0.18 () {58 vars in 1024 bytes} [Sat Sep 24 19:21:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:21:19.783446 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05116249-932c-4a1a-aa3a-f94fc38bb9d5 None None] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:19.783641 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57ae4ec-3e52-4257-ba4c-1071b4671444 None None] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:19.918243 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57ae4ec-3e52-4257-ba4c-1071b4671444 None None] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:19.930774 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05116249-932c-4a1a-aa3a-f94fc38bb9d5 None None] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:19.939692 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:19.959585 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebb1002-5a75-4d2e-b4e6-2d96f91f980c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:19.960550 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebb1002-5a75-4d2e-b4e6-2d96f91f980c None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:19.960830 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebb1002-5a75-4d2e-b4e6-2d96f91f980c None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:19.961378 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebb1002-5a75-4d2e-b4e6-2d96f91f980c None admin] PATH_INFO: `/v3/roles/member` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:19.969220 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e655ea-4226-410d-ae36-145c77e3578b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:19.969850 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e655ea-4226-410d-ae36-145c77e3578b None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:19.970215 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e655ea-4226-410d-ae36-145c77e3578b None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:19.970481 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e655ea-4226-410d-ae36-145c77e3578b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:19.973266 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebb1002-5a75-4d2e-b4e6-2d96f91f980c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:21:19.978633 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application [None req-bebb1002-5a75-4d2e-b4e6-2d96f91f980c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 24 19:21:19.978633 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:21:19.978633 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:21:19.978633 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:21:19.978633 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:21:19.978633 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:21:19.978633 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:21:19.978633 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:21:19.978633 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:21:19.978633 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:21:19.978633 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:21:19.978633 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:21:19.978633 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:21:19.978633 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:21:19.978633 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:21:19.978633 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:21:19.979674 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:21:19.979674 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:21:19.979674 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:21:19.979674 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:21:19.979674 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:21:19.979674 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:21:19.979674 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:21:19.979674 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:21:19.979674 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:21:19.979674 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:21:19.979674 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:21:19.979674 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application with Lock( Sep 24 19:21:19.979674 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:21:19.979674 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:21:19.979674 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:21:19.979674 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:21:19.980570 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:21:19.980570 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:21:19.980570 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:21:19.980570 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:21:19.980570 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:21:19.980570 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:21:19.980570 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:21:19.980570 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:21:19.980570 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:21:19.980570 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:21:19.980570 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 24 19:21:19.980570 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Sep 24 19:21:19.982789 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 154/301] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Sep 24 19:21:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:21:19.983581 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebb1002-5a75-4d2e-b4e6-2d96f91f980c None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:19.988548 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e655ea-4226-410d-ae36-145c77e3578b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:21:19.994326 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application [None req-a2e655ea-4226-410d-ae36-145c77e3578b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 24 19:21:19.994326 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:21:19.994326 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:21:19.994326 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:21:19.994326 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:21:19.994326 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:21:19.994326 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:21:19.994326 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:21:19.994326 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:21:19.994326 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:21:19.994326 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:21:19.994326 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:21:19.994326 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:21:19.994326 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:21:19.994326 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:21:19.994326 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:21:19.995221 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:21:19.995221 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:21:19.995221 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:21:19.995221 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:21:19.995221 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:21:19.995221 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:21:19.995221 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:21:19.995221 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:21:19.995221 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:21:19.995221 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:21:19.995221 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:21:19.995221 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application with Lock( Sep 24 19:21:19.995221 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:21:19.995221 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:21:19.995221 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:21:19.995221 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:21:19.996010 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:21:19.996010 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:21:19.996010 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:21:19.996010 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:21:19.996010 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:21:19.996010 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:21:19.996010 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:21:19.996010 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:21:19.996010 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:21:19.996010 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:21:19.996010 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 24 19:21:19.996010 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Sep 24 19:21:19.996010 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 148/302] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Sep 24 19:21:19 2022] GET /identity/v3/roles/reader => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:21:19.997151 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e655ea-4226-410d-ae36-145c77e3578b None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:20.027257 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:20.102086 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebb1002-5a75-4d2e-b4e6-2d96f91f980c None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:20.128045 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e655ea-4226-410d-ae36-145c77e3578b None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:20.141093 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce3bc95-7b30-4989-80c3-d865796fafc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:20.142478 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce3bc95-7b30-4989-80c3-d865796fafc1 None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:20.142929 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce3bc95-7b30-4989-80c3-d865796fafc1 None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:20.143363 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce3bc95-7b30-4989-80c3-d865796fafc1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:20.145000 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce3bc95-7b30-4989-80c3-d865796fafc1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:20.146477 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce3bc95-7b30-4989-80c3-d865796fafc1 None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:20.148058 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 155/303] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Sep 24 19:21:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:21:20.150711 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce3bc95-7b30-4989-80c3-d865796fafc1 None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:20.167605 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5c61e8-e473-4edb-a04e-d1e381293ad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:20.168216 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5c61e8-e473-4edb-a04e-d1e381293ad7 None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:20.168561 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5c61e8-e473-4edb-a04e-d1e381293ad7 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:20.168940 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5c61e8-e473-4edb-a04e-d1e381293ad7 None admin] PATH_INFO: `/v3/roles` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:20.169612 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5c61e8-e473-4edb-a04e-d1e381293ad7 None admin] RBAC: Adding query filter params (name=member) {{(pid=88081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:21:20.170344 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5c61e8-e473-4edb-a04e-d1e381293ad7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:20.171715 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5c61e8-e473-4edb-a04e-d1e381293ad7 None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:20.181806 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 149/304] 10.222.0.18 () {56 vars in 1101 bytes} [Sat Sep 24 19:21:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:21:20.183010 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5c61e8-e473-4edb-a04e-d1e381293ad7 None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:20.218982 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:20.264398 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce3bc95-7b30-4989-80c3-d865796fafc1 None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:20.268008 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:20.303246 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5c61e8-e473-4edb-a04e-d1e381293ad7 None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:20.306859 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79640249-d7bf-4f3a-be62-c7192bef30fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:20.307513 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79640249-d7bf-4f3a-be62-c7192bef30fe None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:20.307828 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79640249-d7bf-4f3a-be62-c7192bef30fe None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:20.308136 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79640249-d7bf-4f3a-be62-c7192bef30fe None admin] PATH_INFO: `/v3/roles` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:20.308840 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79640249-d7bf-4f3a-be62-c7192bef30fe None admin] RBAC: Adding query filter params (name=reader) {{(pid=88080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:21:20.309181 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79640249-d7bf-4f3a-be62-c7192bef30fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:20.311074 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79640249-d7bf-4f3a-be62-c7192bef30fe None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:20.320980 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 156/305] 10.222.0.18 () {56 vars in 1101 bytes} [Sat Sep 24 19:21:20 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:21:20.326400 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79640249-d7bf-4f3a-be62-c7192bef30fe None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:20.342089 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a00b83-d692-4a99-8e57-c5082b7d8ec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:20.342649 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a00b83-d692-4a99-8e57-c5082b7d8ec6 None admin] REQUEST_METHOD: `POST` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:20.342930 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a00b83-d692-4a99-8e57-c5082b7d8ec6 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:20.343259 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a00b83-d692-4a99-8e57-c5082b7d8ec6 None admin] PATH_INFO: `/v3/groups` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:20.343902 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a00b83-d692-4a99-8e57-c5082b7d8ec6 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:20.345351 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a00b83-d692-4a99-8e57-c5082b7d8ec6 None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:20.385055 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 150/306] 10.222.0.18 () {60 vars in 1134 bytes} [Sat Sep 24 19:21:20 2022] POST /identity/v3/groups => generated 229 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:21:20.386050 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a00b83-d692-4a99-8e57-c5082b7d8ec6 None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:20.503883 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79640249-d7bf-4f3a-be62-c7192bef30fe None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:20.512498 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:20.530878 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a00b83-d692-4a99-8e57-c5082b7d8ec6 None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:20.543204 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49742057-14ea-47a0-aa1c-d37d2f61dbcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:20.543887 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49742057-14ea-47a0-aa1c-d37d2f61dbcb None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:20.544206 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49742057-14ea-47a0-aa1c-d37d2f61dbcb None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:20.544518 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49742057-14ea-47a0-aa1c-d37d2f61dbcb None admin] PATH_INFO: `/v3/users/fd19cb7c73794d30aad0f14840c0a050` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:20.545811 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49742057-14ea-47a0-aa1c-d37d2f61dbcb None admin] RBAC: Authorizing `identity:get_user(user_id=fd19cb7c73794d30aad0f14840c0a050)` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:20.547357 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49742057-14ea-47a0-aa1c-d37d2f61dbcb None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:20.549227 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 157/307] 10.222.0.18 () {56 vars in 1177 bytes} [Sat Sep 24 19:21:20 2022] GET /identity/v3/users/fd19cb7c73794d30aad0f14840c0a050 => generated 293 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:21:20.551575 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42af8321-8e55-49d8-a78e-45dc1b169589 None None] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:20.552131 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42af8321-8e55-49d8-a78e-45dc1b169589 None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:20.553075 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42af8321-8e55-49d8-a78e-45dc1b169589 None None] PATH_INFO: `/` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:20.554762 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 158/308] 10.222.0.18 () {54 vars in 927 bytes} [Sat Sep 24 19:21:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:21:20.559151 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42af8321-8e55-49d8-a78e-45dc1b169589 None None] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:20.582803 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2037101-a84c-4cc4-9ee6-3eeec09a6951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:20.583465 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2037101-a84c-4cc4-9ee6-3eeec09a6951 None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:20.583744 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2037101-a84c-4cc4-9ee6-3eeec09a6951 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:20.584019 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2037101-a84c-4cc4-9ee6-3eeec09a6951 None admin] PATH_INFO: `/v3/users/93fdc7e8c6dd4d79900e6dc3ea0945c4` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:20.603482 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2037101-a84c-4cc4-9ee6-3eeec09a6951 None admin] RBAC: Authorizing `identity:get_user(user_id=93fdc7e8c6dd4d79900e6dc3ea0945c4)` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:20.604981 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2037101-a84c-4cc4-9ee6-3eeec09a6951 None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:20.606950 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 151/309] 10.222.0.18 () {56 vars in 1177 bytes} [Sat Sep 24 19:21:20 2022] GET /identity/v3/users/93fdc7e8c6dd4d79900e6dc3ea0945c4 => generated 293 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:21:20.608080 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254a2a54-3fbe-49b1-881a-ec5d58e3bc29 None None] REQUEST_METHOD: `POST` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:20.608360 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254a2a54-3fbe-49b1-881a-ec5d58e3bc29 None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:20.608633 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254a2a54-3fbe-49b1-881a-ec5d58e3bc29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:20.619282 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:20.628584 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.auth.core [None req-254a2a54-3fbe-49b1-881a-ec5d58e3bc29 None None] MFA Rules not processed for user `3dbbb9909cec43ff99c1c3682f016ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=88081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:21:20.629821 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.fernet_utils [None req-254a2a54-3fbe-49b1-881a-ec5d58e3bc29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:21:20.712267 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42af8321-8e55-49d8-a78e-45dc1b169589 None None] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:20.714400 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 152/310] 10.222.0.18 () {58 vars in 1024 bytes} [Sat Sep 24 19:21:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:21:20.715260 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254a2a54-3fbe-49b1-881a-ec5d58e3bc29 None None] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:20.763827 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f96655-9751-4782-9963-a03a23d3ffb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:20.764451 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f96655-9751-4782-9963-a03a23d3ffb1 None admin] REQUEST_METHOD: `PUT` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:20.764791 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f96655-9751-4782-9963-a03a23d3ffb1 None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:20.765108 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f96655-9751-4782-9963-a03a23d3ffb1 None admin] PATH_INFO: `/v3/system/users/fd19cb7c73794d30aad0f14840c0a050/roles/3a42524fc57c4487a34c5c05234413a7` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:20.766793 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f96655-9751-4782-9963-a03a23d3ffb1 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=fd19cb7c73794d30aad0f14840c0a050, role_id=3a42524fc57c4487a34c5c05234413a7)` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:20.768467 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f96655-9751-4782-9963-a03a23d3ffb1 None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:20.783357 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 159/311] 10.222.0.18 () {58 vars in 1334 bytes} [Sat Sep 24 19:21:20 2022] PUT /identity/v3/system/users/fd19cb7c73794d30aad0f14840c0a050/roles/3a42524fc57c4487a34c5c05234413a7 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:21:20.839343 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:20.869034 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254a2a54-3fbe-49b1-881a-ec5d58e3bc29 None None] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:20.909755 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f5dca9-fb15-4125-acb5-8e4e3066b9cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:20.910844 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f5dca9-fb15-4125-acb5-8e4e3066b9cc None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:20.911298 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f5dca9-fb15-4125-acb5-8e4e3066b9cc None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:20.911738 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f5dca9-fb15-4125-acb5-8e4e3066b9cc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:20.912649 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f5dca9-fb15-4125-acb5-8e4e3066b9cc None admin] RBAC: Adding query filter params (role.id=f072ea6ff7ca4dbf90174c318d19acf1, user.id=93fdc7e8c6dd4d79900e6dc3ea0945c4, scope.system=all) {{(pid=88081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:21:20.913206 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f5dca9-fb15-4125-acb5-8e4e3066b9cc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:20.914859 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f5dca9-fb15-4125-acb5-8e4e3066b9cc None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:20.921393 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 153/312] 10.222.0.18 () {56 vars in 1308 bytes} [Sat Sep 24 19:21:20 2022] GET /identity/v3/role_assignments?user.id=93fdc7e8c6dd4d79900e6dc3ea0945c4&scope.system=all&role.id=f072ea6ff7ca4dbf90174c318d19acf1 => generated 226 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:21:21.055171 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f96655-9751-4782-9963-a03a23d3ffb1 None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:21.177551 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:21.186625 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f96655-9751-4782-9963-a03a23d3ffb1 None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:21.275435 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50f409e-90d1-4e3e-931a-79adf1f29d0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:21.280834 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50f409e-90d1-4e3e-931a-79adf1f29d0a None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:21.281119 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50f409e-90d1-4e3e-931a-79adf1f29d0a None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:21.281386 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50f409e-90d1-4e3e-931a-79adf1f29d0a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:21.293307 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50f409e-90d1-4e3e-931a-79adf1f29d0a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:21:21.298397 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application [None req-b50f409e-90d1-4e3e-931a-79adf1f29d0a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 24 19:21:21.298397 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:21:21.298397 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:21:21.298397 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:21:21.298397 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:21:21.298397 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:21:21.298397 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:21:21.298397 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:21:21.298397 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:21:21.298397 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:21:21.298397 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:21:21.298397 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:21:21.298397 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:21:21.298397 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:21:21.298397 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:21:21.298397 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:21:21.299324 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:21:21.299324 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:21:21.299324 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:21:21.299324 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:21:21.299324 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:21:21.299324 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:21:21.299324 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:21:21.299324 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:21:21.299324 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:21:21.299324 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:21:21.299324 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:21:21.299324 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application with Lock( Sep 24 19:21:21.299324 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:21:21.299324 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:21:21.299324 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:21:21.299324 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:21:21.300209 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:21:21.300209 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:21:21.300209 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:21:21.300209 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:21:21.300209 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:21:21.300209 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:21:21.300209 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:21:21.300209 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:21:21.300209 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:21:21.300209 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:21:21.300209 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 24 19:21:21.300209 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Sep 24 19:21:21.300209 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 160/313] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Sep 24 19:21:21 2022] GET /identity/v3/roles/reader => generated 84 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:21:21.307242 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f5dca9-fb15-4125-acb5-8e4e3066b9cc None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:21.449725 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f5dca9-fb15-4125-acb5-8e4e3066b9cc None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:21.485131 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25592d44-7b37-4aaa-9eac-5be68672a8c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:21.485736 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25592d44-7b37-4aaa-9eac-5be68672a8c2 None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:21.486036 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25592d44-7b37-4aaa-9eac-5be68672a8c2 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:21.486301 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25592d44-7b37-4aaa-9eac-5be68672a8c2 None admin] PATH_INFO: `/v3/roles` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:21.486952 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25592d44-7b37-4aaa-9eac-5be68672a8c2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:21:21.487762 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25592d44-7b37-4aaa-9eac-5be68672a8c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:21.489198 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25592d44-7b37-4aaa-9eac-5be68672a8c2 None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:21.498261 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 154/314] 10.222.0.18 () {56 vars in 1101 bytes} [Sat Sep 24 19:21:21 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:21:21.504212 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50f409e-90d1-4e3e-931a-79adf1f29d0a None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:21.659305 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50f409e-90d1-4e3e-931a-79adf1f29d0a None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:21.715793 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8262685d-af5c-4b3d-a9ad-a685d632b981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:21.716427 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8262685d-af5c-4b3d-a9ad-a685d632b981 None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:21.716749 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8262685d-af5c-4b3d-a9ad-a685d632b981 None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:21.717017 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8262685d-af5c-4b3d-a9ad-a685d632b981 None admin] PATH_INFO: `/v3/users/d2653aeb65964617a83dd1b899f8a540` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:21.718186 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8262685d-af5c-4b3d-a9ad-a685d632b981 None admin] RBAC: Authorizing `identity:get_user(user_id=d2653aeb65964617a83dd1b899f8a540)` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:21.719696 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8262685d-af5c-4b3d-a9ad-a685d632b981 None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:21.721449 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 161/315] 10.222.0.18 () {56 vars in 1177 bytes} [Sat Sep 24 19:21:21 2022] GET /identity/v3/users/d2653aeb65964617a83dd1b899f8a540 => generated 297 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:21:21.727157 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25592d44-7b37-4aaa-9eac-5be68672a8c2 None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:21.742319 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:21.859972 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25592d44-7b37-4aaa-9eac-5be68672a8c2 None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:21.904450 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f418460-25c5-48dd-84bb-a5df6faa7366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:21.905066 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f418460-25c5-48dd-84bb-a5df6faa7366 None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:21.905351 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f418460-25c5-48dd-84bb-a5df6faa7366 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:21.905628 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f418460-25c5-48dd-84bb-a5df6faa7366 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:21.988438 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f418460-25c5-48dd-84bb-a5df6faa7366 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:21.989806 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f418460-25c5-48dd-84bb-a5df6faa7366 None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:21.992243 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:22.106220 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 155/316] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Sep 24 19:21:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 24 19:21:22.112935 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8262685d-af5c-4b3d-a9ad-a685d632b981 None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:22.144582 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:22.256202 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8262685d-af5c-4b3d-a9ad-a685d632b981 None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:22.296879 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271a8c34-a5bf-4f47-98fd-53c27601694c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:22.297942 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271a8c34-a5bf-4f47-98fd-53c27601694c None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:22.298434 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271a8c34-a5bf-4f47-98fd-53c27601694c None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:22.298922 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271a8c34-a5bf-4f47-98fd-53c27601694c None admin] PATH_INFO: `/v3/projects/b86798f4dc4d4dd79428558b3d00ae1a` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:22.300899 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271a8c34-a5bf-4f47-98fd-53c27601694c None admin] RBAC: Authorizing `identity:get_project(project_id=b86798f4dc4d4dd79428558b3d00ae1a)` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:22.302747 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271a8c34-a5bf-4f47-98fd-53c27601694c None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:22.304688 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 162/317] 10.222.0.18 () {56 vars in 1186 bytes} [Sat Sep 24 19:21:22 2022] GET /identity/v3/projects/b86798f4dc4d4dd79428558b3d00ae1a => generated 302 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:21:22.311285 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f418460-25c5-48dd-84bb-a5df6faa7366 None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:22.430932 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f418460-25c5-48dd-84bb-a5df6faa7366 None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:22.433236 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:22.472172 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20236259-bd63-4b25-b11f-6df8f04d1b06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:22.472793 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20236259-bd63-4b25-b11f-6df8f04d1b06 None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:22.473071 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20236259-bd63-4b25-b11f-6df8f04d1b06 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:22.473383 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20236259-bd63-4b25-b11f-6df8f04d1b06 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:22.474182 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20236259-bd63-4b25-b11f-6df8f04d1b06 None admin] RBAC: Adding query filter params (role.id=f072ea6ff7ca4dbf90174c318d19acf1, scope.project.id=b86798f4dc4d4dd79428558b3d00ae1a, user.id=d2653aeb65964617a83dd1b899f8a540) {{(pid=88081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:21:22.474491 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20236259-bd63-4b25-b11f-6df8f04d1b06 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:22.475950 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20236259-bd63-4b25-b11f-6df8f04d1b06 None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:22.483408 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 156/318] 10.222.0.18 () {56 vars in 1374 bytes} [Sat Sep 24 19:21:22 2022] GET /identity/v3/role_assignments?user.id=d2653aeb65964617a83dd1b899f8a540&scope.project.id=b86798f4dc4d4dd79428558b3d00ae1a&role.id=f072ea6ff7ca4dbf90174c318d19acf1 => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:21:23.135667 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0595ae-6f17-450c-b3d9-45e4b99151a7 None None] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:23.136219 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0595ae-6f17-450c-b3d9-45e4b99151a7 None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:23.136219 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0595ae-6f17-450c-b3d9-45e4b99151a7 None None] PATH_INFO: `/` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:23.137788 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 163/319] 10.222.0.18 () {54 vars in 927 bytes} [Sat Sep 24 19:21:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:21:23.143086 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969de0b0-67cb-41e2-9edb-659cebde05c1 None None] REQUEST_METHOD: `POST` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:23.143408 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969de0b0-67cb-41e2-9edb-659cebde05c1 None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:23.143685 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969de0b0-67cb-41e2-9edb-659cebde05c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:23.162150 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.auth.core [None req-969de0b0-67cb-41e2-9edb-659cebde05c1 None None] MFA Rules not processed for user `3dbbb9909cec43ff99c1c3682f016ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=88081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:21:23.163385 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.fernet_utils [None req-969de0b0-67cb-41e2-9edb-659cebde05c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:21:23.243668 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 157/320] 10.222.0.18 () {58 vars in 1024 bytes} [Sat Sep 24 19:21:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:21:23.514853 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dccd7a6-df61-42d2-b3f7-fffe457303cd None None] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:23.515031 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dccd7a6-df61-42d2-b3f7-fffe457303cd None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:23.515311 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dccd7a6-df61-42d2-b3f7-fffe457303cd None None] PATH_INFO: `/` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:23.516635 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 164/321] 10.222.0.18 () {54 vars in 927 bytes} [Sat Sep 24 19:21:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:21:23.522121 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bdd918-94d3-427a-9fad-3ead2002dcfb None None] REQUEST_METHOD: `POST` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:23.522591 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bdd918-94d3-427a-9fad-3ead2002dcfb None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:23.522673 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bdd918-94d3-427a-9fad-3ead2002dcfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:23.541219 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.auth.core [None req-11bdd918-94d3-427a-9fad-3ead2002dcfb None None] MFA Rules not processed for user `3dbbb9909cec43ff99c1c3682f016ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=88081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:21:23.542414 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.fernet_utils [None req-11bdd918-94d3-427a-9fad-3ead2002dcfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:21:23.572626 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dccd7a6-df61-42d2-b3f7-fffe457303cd None None] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:23.620264 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 158/322] 10.222.0.18 () {58 vars in 1024 bytes} [Sat Sep 24 19:21:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 24 19:21:23.640509 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5385df39-477f-4a26-a25e-500ee6263134 None None] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:23.640792 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5385df39-477f-4a26-a25e-500ee6263134 None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:23.641064 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5385df39-477f-4a26-a25e-500ee6263134 None None] PATH_INFO: `/` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:23.642579 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 159/323] 10.222.0.18 () {54 vars in 927 bytes} [Sat Sep 24 19:21:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 24 19:21:23.647432 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd64e25f-659c-402b-9958-54802b67c0f5 None None] REQUEST_METHOD: `POST` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:23.647706 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd64e25f-659c-402b-9958-54802b67c0f5 None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:23.647987 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd64e25f-659c-402b-9958-54802b67c0f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:23.667905 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.auth.core [None req-fd64e25f-659c-402b-9958-54802b67c0f5 None None] MFA Rules not processed for user `3dbbb9909cec43ff99c1c3682f016ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=88081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:21:23.669108 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.fernet_utils [None req-fd64e25f-659c-402b-9958-54802b67c0f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:21:23.689800 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:23.692582 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:23.700868 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dccd7a6-df61-42d2-b3f7-fffe457303cd None None] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:23.742063 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 160/324] 10.222.0.18 () {58 vars in 1024 bytes} [Sat Sep 24 19:21:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 24 19:21:23.747107 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a6e9e8-f672-4a19-a8e4-a9a4afd42ea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:23.747107 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a6e9e8-f672-4a19-a8e4-a9a4afd42ea4 None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:23.747107 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a6e9e8-f672-4a19-a8e4-a9a4afd42ea4 None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:23.747107 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a6e9e8-f672-4a19-a8e4-a9a4afd42ea4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:23.747584 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a6e9e8-f672-4a19-a8e4-a9a4afd42ea4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:23.748977 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a6e9e8-f672-4a19-a8e4-a9a4afd42ea4 None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:23.753865 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 165/325] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Sep 24 19:21:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:21:23.757207 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd64e25f-659c-402b-9958-54802b67c0f5 None None] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:23.862576 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd64e25f-659c-402b-9958-54802b67c0f5 None None] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:23.897574 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a54f38-36fa-4a8a-8ace-203e03ae3e0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:23.898207 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a54f38-36fa-4a8a-8ace-203e03ae3e0f None admin] REQUEST_METHOD: `POST` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:23.898482 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a54f38-36fa-4a8a-8ace-203e03ae3e0f None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:23.898749 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a54f38-36fa-4a8a-8ace-203e03ae3e0f None admin] PATH_INFO: `/v3/groups` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:23.899376 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a54f38-36fa-4a8a-8ace-203e03ae3e0f None admin] RBAC: Authorizing `identity:create_group()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:23.900783 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a54f38-36fa-4a8a-8ace-203e03ae3e0f None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:23.917999 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 161/326] 10.222.0.18 () {60 vars in 1134 bytes} [Sat Sep 24 19:21:23 2022] POST /identity/v3/groups => generated 226 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 24 19:21:23.944221 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a6e9e8-f672-4a19-a8e4-a9a4afd42ea4 None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:24.054637 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a6e9e8-f672-4a19-a8e4-a9a4afd42ea4 None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:24.072787 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a54f38-36fa-4a8a-8ace-203e03ae3e0f None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:24.092761 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47f5c43-9ce8-40a9-8b8d-3d541ba11033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:24.093400 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47f5c43-9ce8-40a9-8b8d-3d541ba11033 None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:24.093676 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47f5c43-9ce8-40a9-8b8d-3d541ba11033 None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:24.093977 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47f5c43-9ce8-40a9-8b8d-3d541ba11033 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:24.098495 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:24.106714 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47f5c43-9ce8-40a9-8b8d-3d541ba11033 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:21:24.114374 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application [None req-c47f5c43-9ce8-40a9-8b8d-3d541ba11033 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 24 19:21:24.114374 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:21:24.114374 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:21:24.114374 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:21:24.114374 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:21:24.114374 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:21:24.114374 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:21:24.114374 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:21:24.114374 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:21:24.114374 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:21:24.114374 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:21:24.114374 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:21:24.114374 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:21:24.114374 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:21:24.114374 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:21:24.114374 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:21:24.115312 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:21:24.115312 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:21:24.115312 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:21:24.115312 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:21:24.115312 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:21:24.115312 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:21:24.115312 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:21:24.115312 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:21:24.115312 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:21:24.115312 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:21:24.115312 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:21:24.115312 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application with Lock( Sep 24 19:21:24.115312 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:21:24.115312 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:21:24.115312 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:21:24.115312 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:21:24.116086 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:21:24.116086 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:21:24.116086 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:21:24.116086 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:21:24.116086 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:21:24.116086 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:21:24.116086 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:21:24.116086 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:21:24.116086 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:21:24.116086 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:21:24.116086 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 24 19:21:24.116086 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Sep 24 19:21:24.116086 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 166/327] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Sep 24 19:21:23 2022] GET /identity/v3/roles/reader => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:21:24.122224 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47f5c43-9ce8-40a9-8b8d-3d541ba11033 None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:24.150423 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:24.210999 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a54f38-36fa-4a8a-8ace-203e03ae3e0f None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:24.250664 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6378edda-4062-44b9-866b-794943172240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:24.251468 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6378edda-4062-44b9-866b-794943172240 None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:24.251747 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6378edda-4062-44b9-866b-794943172240 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:24.252018 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6378edda-4062-44b9-866b-794943172240 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:24.253314 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47f5c43-9ce8-40a9-8b8d-3d541ba11033 None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:24.263932 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6378edda-4062-44b9-866b-794943172240 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:21:24.270416 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application [None req-6378edda-4062-44b9-866b-794943172240 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 24 19:21:24.270416 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:21:24.270416 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:21:24.270416 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:21:24.270416 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:21:24.270416 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:21:24.270416 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:21:24.270416 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:21:24.270416 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:21:24.270416 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:21:24.270416 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:21:24.270416 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:21:24.270416 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:21:24.270416 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:21:24.270416 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:21:24.270416 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:21:24.271331 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:21:24.271331 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:21:24.271331 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:21:24.271331 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:21:24.271331 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:21:24.271331 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:21:24.271331 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:21:24.271331 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:21:24.271331 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:21:24.271331 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:21:24.271331 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:21:24.271331 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application with Lock( Sep 24 19:21:24.271331 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:21:24.271331 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:21:24.271331 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:21:24.271331 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:21:24.272645 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:21:24.272645 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:21:24.272645 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:21:24.272645 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:21:24.272645 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:21:24.272645 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:21:24.272645 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:21:24.272645 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:21:24.272645 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:21:24.272645 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:21:24.272645 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 24 19:21:24.272645 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Sep 24 19:21:24.272645 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 162/328] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Sep 24 19:21:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 19:21:24.278485 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6378edda-4062-44b9-866b-794943172240 None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:24.296322 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a3b3c2-c8b2-4978-b8ce-7671299f07a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:24.296929 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a3b3c2-c8b2-4978-b8ce-7671299f07a4 None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:24.297202 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a3b3c2-c8b2-4978-b8ce-7671299f07a4 None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:24.297637 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a3b3c2-c8b2-4978-b8ce-7671299f07a4 None admin] PATH_INFO: `/v3/roles` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:24.300676 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a3b3c2-c8b2-4978-b8ce-7671299f07a4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:21:24.300676 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a3b3c2-c8b2-4978-b8ce-7671299f07a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:24.300676 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a3b3c2-c8b2-4978-b8ce-7671299f07a4 None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:24.310842 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 167/329] 10.222.0.18 () {56 vars in 1101 bytes} [Sat Sep 24 19:21:24 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:21:24.318915 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a3b3c2-c8b2-4978-b8ce-7671299f07a4 None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:24.376099 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:24.411526 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6378edda-4062-44b9-866b-794943172240 None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:24.432410 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:24.452985 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a3b3c2-c8b2-4978-b8ce-7671299f07a4 None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:24.457222 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01b6190-91f5-4c89-ba29-0a9ae1c44bd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:24.458136 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01b6190-91f5-4c89-ba29-0a9ae1c44bd8 None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:24.458666 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01b6190-91f5-4c89-ba29-0a9ae1c44bd8 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:24.459139 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01b6190-91f5-4c89-ba29-0a9ae1c44bd8 None admin] PATH_INFO: `/v3/roles` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:24.460035 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01b6190-91f5-4c89-ba29-0a9ae1c44bd8 None admin] RBAC: Adding query filter params (name=member) {{(pid=88081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:21:24.460336 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01b6190-91f5-4c89-ba29-0a9ae1c44bd8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:24.461728 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01b6190-91f5-4c89-ba29-0a9ae1c44bd8 None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:24.475183 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 163/330] 10.222.0.18 () {56 vars in 1101 bytes} [Sat Sep 24 19:21:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:21:24.480354 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01b6190-91f5-4c89-ba29-0a9ae1c44bd8 None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:24.508288 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe3b932-e92d-4455-911a-65249f1cd068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:24.508940 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe3b932-e92d-4455-911a-65249f1cd068 None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:24.509216 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe3b932-e92d-4455-911a-65249f1cd068 None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:24.509488 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe3b932-e92d-4455-911a-65249f1cd068 None admin] PATH_INFO: `/v3/users/93fdc7e8c6dd4d79900e6dc3ea0945c4` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:24.511460 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe3b932-e92d-4455-911a-65249f1cd068 None admin] RBAC: Authorizing `identity:get_user(user_id=93fdc7e8c6dd4d79900e6dc3ea0945c4)` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:24.513268 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe3b932-e92d-4455-911a-65249f1cd068 None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:24.516005 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 168/331] 10.222.0.18 () {56 vars in 1177 bytes} [Sat Sep 24 19:21:24 2022] GET /identity/v3/users/93fdc7e8c6dd4d79900e6dc3ea0945c4 => generated 293 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:21:24.521684 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe3b932-e92d-4455-911a-65249f1cd068 None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:24.619761 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01b6190-91f5-4c89-ba29-0a9ae1c44bd8 None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:24.654664 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe3b932-e92d-4455-911a-65249f1cd068 None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:24.667785 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c40769-2755-4eb5-8862-72f5fdcdd1b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:24.668424 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c40769-2755-4eb5-8862-72f5fdcdd1b4 None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:24.668698 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c40769-2755-4eb5-8862-72f5fdcdd1b4 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:24.668959 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c40769-2755-4eb5-8862-72f5fdcdd1b4 None admin] PATH_INFO: `/v3/users/fd19cb7c73794d30aad0f14840c0a050` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:24.673263 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c40769-2755-4eb5-8862-72f5fdcdd1b4 None admin] RBAC: Authorizing `identity:get_user(user_id=fd19cb7c73794d30aad0f14840c0a050)` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:24.677320 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c40769-2755-4eb5-8862-72f5fdcdd1b4 None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:24.679033 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 164/332] 10.222.0.18 () {56 vars in 1177 bytes} [Sat Sep 24 19:21:24 2022] GET /identity/v3/users/fd19cb7c73794d30aad0f14840c0a050 => generated 293 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:21:24.685030 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c40769-2755-4eb5-8862-72f5fdcdd1b4 None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:24.698442 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:24.705748 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c60683-fed9-4819-9a25-57e28a4ca163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:24.706994 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c60683-fed9-4819-9a25-57e28a4ca163 None admin] REQUEST_METHOD: `PUT` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:24.707491 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c60683-fed9-4819-9a25-57e28a4ca163 None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:24.708406 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c60683-fed9-4819-9a25-57e28a4ca163 None admin] PATH_INFO: `/v3/system/users/93fdc7e8c6dd4d79900e6dc3ea0945c4/roles/f072ea6ff7ca4dbf90174c318d19acf1` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:24.710415 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c60683-fed9-4819-9a25-57e28a4ca163 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=93fdc7e8c6dd4d79900e6dc3ea0945c4, role_id=f072ea6ff7ca4dbf90174c318d19acf1)` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:24.712553 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c60683-fed9-4819-9a25-57e28a4ca163 None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:24.723260 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 169/333] 10.222.0.18 () {58 vars in 1334 bytes} [Sat Sep 24 19:21:24 2022] PUT /identity/v3/system/users/93fdc7e8c6dd4d79900e6dc3ea0945c4/roles/f072ea6ff7ca4dbf90174c318d19acf1 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 24 19:21:24.809304 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c40769-2755-4eb5-8862-72f5fdcdd1b4 None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:24.848615 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c0223d-9aa2-49b8-82b1-e5e995d0a738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:24.849252 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c0223d-9aa2-49b8-82b1-e5e995d0a738 None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:24.849524 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c0223d-9aa2-49b8-82b1-e5e995d0a738 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:24.849803 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c0223d-9aa2-49b8-82b1-e5e995d0a738 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:24.850592 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c0223d-9aa2-49b8-82b1-e5e995d0a738 None admin] RBAC: Adding query filter params (role.id=3a42524fc57c4487a34c5c05234413a7, user.id=fd19cb7c73794d30aad0f14840c0a050, scope.system=all) {{(pid=88081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:21:24.850909 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c0223d-9aa2-49b8-82b1-e5e995d0a738 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:24.852521 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c0223d-9aa2-49b8-82b1-e5e995d0a738 None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:24.866080 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 165/334] 10.222.0.18 () {56 vars in 1308 bytes} [Sat Sep 24 19:21:24 2022] GET /identity/v3/role_assignments?user.id=fd19cb7c73794d30aad0f14840c0a050&scope.system=all&role.id=3a42524fc57c4487a34c5c05234413a7 => generated 510 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:21:27.015231 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5594fe-ece4-44f2-b46e-30ef04a33b97 None None] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:27.015714 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5594fe-ece4-44f2-b46e-30ef04a33b97 None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:27.015714 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5594fe-ece4-44f2-b46e-30ef04a33b97 None None] PATH_INFO: `/` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:27.017267 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 170/335] 10.222.0.18 () {54 vars in 927 bytes} [Sat Sep 24 19:21:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:21:27.024468 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3ab38b-cb74-48d9-b6db-7ddbac5045be None None] REQUEST_METHOD: `POST` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:27.024922 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3ab38b-cb74-48d9-b6db-7ddbac5045be None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:27.025012 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3ab38b-cb74-48d9-b6db-7ddbac5045be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:27.044431 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.auth.core [None req-9b3ab38b-cb74-48d9-b6db-7ddbac5045be None None] MFA Rules not processed for user `3dbbb9909cec43ff99c1c3682f016ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=88081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:21:27.045636 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.fernet_utils [None req-9b3ab38b-cb74-48d9-b6db-7ddbac5045be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:21:27.120833 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:27.132278 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 166/336] 10.222.0.18 () {58 vars in 1024 bytes} [Sat Sep 24 19:21:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:21:27.609509 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46358210-81a0-4028-9a8e-09c4c8a687c0 None None] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:27.610054 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46358210-81a0-4028-9a8e-09c4c8a687c0 None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:27.610473 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46358210-81a0-4028-9a8e-09c4c8a687c0 None None] PATH_INFO: `/` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:27.612289 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 171/337] 10.222.0.18 () {54 vars in 927 bytes} [Sat Sep 24 19:21:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:21:27.617862 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1744192-9ed9-490a-883f-e8714567f04b None None] REQUEST_METHOD: `POST` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:27.618163 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1744192-9ed9-490a-883f-e8714567f04b None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:27.618442 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1744192-9ed9-490a-883f-e8714567f04b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:27.644112 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.auth.core [None req-f1744192-9ed9-490a-883f-e8714567f04b None None] MFA Rules not processed for user `3dbbb9909cec43ff99c1c3682f016ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=88081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:21:27.645312 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.fernet_utils [None req-f1744192-9ed9-490a-883f-e8714567f04b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:21:27.739886 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 167/338] 10.222.0.18 () {58 vars in 1024 bytes} [Sat Sep 24 19:21:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:21:27.763767 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d218d4d7-a63b-4b5c-95aa-07cc14eceebc None None] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:27.764303 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d218d4d7-a63b-4b5c-95aa-07cc14eceebc None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:27.764771 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d218d4d7-a63b-4b5c-95aa-07cc14eceebc None None] PATH_INFO: `/` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:27.766580 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 172/339] 10.222.0.18 () {54 vars in 927 bytes} [Sat Sep 24 19:21:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:21:27.772973 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1be2135-999d-44cf-9d4c-9a895a39befa None None] REQUEST_METHOD: `POST` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:27.772973 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1be2135-999d-44cf-9d4c-9a895a39befa None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:27.772973 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1be2135-999d-44cf-9d4c-9a895a39befa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:27.798587 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.auth.core [None req-f1be2135-999d-44cf-9d4c-9a895a39befa None None] MFA Rules not processed for user `3dbbb9909cec43ff99c1c3682f016ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=88081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:21:27.799812 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.fernet_utils [None req-f1be2135-999d-44cf-9d4c-9a895a39befa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:21:27.860103 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d218d4d7-a63b-4b5c-95aa-07cc14eceebc None None] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:27.890245 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 168/340] 10.222.0.18 () {58 vars in 1024 bytes} [Sat Sep 24 19:21:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:21:27.906970 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:28.030459 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d218d4d7-a63b-4b5c-95aa-07cc14eceebc None None] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:28.078124 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac98d85-0e09-4a3e-9315-93d8099f7bb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:28.079111 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac98d85-0e09-4a3e-9315-93d8099f7bb2 None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:28.079600 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac98d85-0e09-4a3e-9315-93d8099f7bb2 None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:28.080067 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac98d85-0e09-4a3e-9315-93d8099f7bb2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:28.094923 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac98d85-0e09-4a3e-9315-93d8099f7bb2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:21:28.100200 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application [None req-dac98d85-0e09-4a3e-9315-93d8099f7bb2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 24 19:21:28.100200 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:21:28.100200 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:21:28.100200 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:21:28.100200 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:21:28.100200 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:21:28.100200 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:21:28.100200 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:21:28.100200 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:21:28.100200 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:21:28.100200 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:21:28.100200 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:21:28.100200 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:21:28.100200 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:21:28.100200 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:21:28.100200 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:21:28.101083 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:21:28.101083 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:21:28.101083 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:21:28.101083 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:21:28.101083 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:21:28.101083 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:21:28.101083 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:21:28.101083 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:21:28.101083 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:21:28.101083 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:21:28.101083 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:21:28.101083 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application with Lock( Sep 24 19:21:28.101083 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:21:28.101083 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:21:28.101083 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:21:28.101083 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:21:28.101890 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:21:28.101890 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:21:28.101890 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:21:28.101890 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:21:28.101890 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:21:28.101890 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:21:28.101890 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:21:28.101890 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:21:28.101890 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:21:28.101890 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:21:28.101890 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 24 19:21:28.101890 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Sep 24 19:21:28.104451 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 173/341] 10.222.0.18 () {56 vars in 1114 bytes} [Sat Sep 24 19:21:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:21:28.110495 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1be2135-999d-44cf-9d4c-9a895a39befa None None] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:28.192963 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:28.248060 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac98d85-0e09-4a3e-9315-93d8099f7bb2 None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:28.249033 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1be2135-999d-44cf-9d4c-9a895a39befa None None] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:28.314253 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f421f4-ac28-48a4-a66c-40205e7a4540 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:28.314953 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f421f4-ac28-48a4-a66c-40205e7a4540 None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:28.315238 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f421f4-ac28-48a4-a66c-40205e7a4540 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:28.315511 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f421f4-ac28-48a4-a66c-40205e7a4540 None admin] PATH_INFO: `/v3/roles` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:28.316186 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f421f4-ac28-48a4-a66c-40205e7a4540 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:21:28.316490 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f421f4-ac28-48a4-a66c-40205e7a4540 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:28.321905 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f421f4-ac28-48a4-a66c-40205e7a4540 None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:28.333251 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 169/342] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Sep 24 19:21:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:21:28.339029 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f421f4-ac28-48a4-a66c-40205e7a4540 None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:28.388188 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:28.432946 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac98d85-0e09-4a3e-9315-93d8099f7bb2 None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:28.504343 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe64998e-4465-4cfa-a0aa-a4a0e7158980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:28.504999 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe64998e-4465-4cfa-a0aa-a4a0e7158980 None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:28.505277 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe64998e-4465-4cfa-a0aa-a4a0e7158980 None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:28.505543 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe64998e-4465-4cfa-a0aa-a4a0e7158980 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:28.526999 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe64998e-4465-4cfa-a0aa-a4a0e7158980 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:21:28.527201 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f421f4-ac28-48a4-a66c-40205e7a4540 None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:28.532096 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application [None req-fe64998e-4465-4cfa-a0aa-a4a0e7158980 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 24 19:21:28.532096 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:21:28.532096 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:21:28.532096 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:21:28.532096 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:21:28.532096 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:21:28.532096 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:21:28.532096 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:21:28.532096 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:21:28.532096 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:21:28.532096 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:21:28.532096 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:21:28.532096 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:21:28.532096 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:21:28.532096 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:21:28.532096 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:21:28.533071 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:21:28.533071 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:21:28.533071 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:21:28.533071 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:21:28.533071 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:21:28.533071 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:21:28.533071 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:21:28.533071 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:21:28.533071 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:21:28.533071 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:21:28.533071 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:21:28.533071 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application with Lock( Sep 24 19:21:28.533071 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:21:28.533071 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:21:28.533071 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:21:28.533071 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:21:28.533933 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:21:28.533933 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:21:28.533933 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:21:28.533933 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:21:28.533933 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:21:28.533933 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:21:28.533933 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:21:28.533933 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:21:28.533933 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:21:28.533933 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:21:28.533933 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 24 19:21:28.533933 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Sep 24 19:21:28.533933 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 174/343] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Sep 24 19:21:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 19:21:28.534589 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe64998e-4465-4cfa-a0aa-a4a0e7158980 None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:28.566438 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:28.589505 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0f8d52-b32d-4827-b948-c9d7472c78ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:28.590173 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0f8d52-b32d-4827-b948-c9d7472c78ce None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:28.590457 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0f8d52-b32d-4827-b948-c9d7472c78ce None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:28.590731 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0f8d52-b32d-4827-b948-c9d7472c78ce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:28.720326 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe64998e-4465-4cfa-a0aa-a4a0e7158980 None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:28.737559 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0f8d52-b32d-4827-b948-c9d7472c78ce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:28.743914 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0f8d52-b32d-4827-b948-c9d7472c78ce None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:28.787552 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bed9685-09a0-46bb-ac81-ff904da05eac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:28.788425 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bed9685-09a0-46bb-ac81-ff904da05eac None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:28.788839 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bed9685-09a0-46bb-ac81-ff904da05eac None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:28.789260 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bed9685-09a0-46bb-ac81-ff904da05eac None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:28.792584 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:28.802428 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bed9685-09a0-46bb-ac81-ff904da05eac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:21:28.808538 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application [None req-9bed9685-09a0-46bb-ac81-ff904da05eac None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 24 19:21:28.808538 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:21:28.808538 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:21:28.808538 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:21:28.808538 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:21:28.808538 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:21:28.808538 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:21:28.808538 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:21:28.808538 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:21:28.808538 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:21:28.808538 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:21:28.808538 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:21:28.808538 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:21:28.808538 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:21:28.808538 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:21:28.808538 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:21:28.809625 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:21:28.809625 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:21:28.809625 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:21:28.809625 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:21:28.809625 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:21:28.809625 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:21:28.809625 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:21:28.809625 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:21:28.809625 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:21:28.809625 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:21:28.809625 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:21:28.809625 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application with Lock( Sep 24 19:21:28.809625 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:21:28.809625 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:21:28.809625 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:21:28.809625 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:21:28.810702 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:21:28.810702 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:21:28.810702 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:21:28.810702 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:21:28.810702 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:21:28.810702 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:21:28.810702 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:21:28.810702 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:21:28.810702 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:21:28.810702 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:21:28.810702 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 24 19:21:28.810702 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Sep 24 19:21:28.812552 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 175/344] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Sep 24 19:21:28 2022] GET /identity/v3/roles/reader => generated 84 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:21:28.813622 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bed9685-09a0-46bb-ac81-ff904da05eac None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:28.898310 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 170/345] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Sep 24 19:21:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 560 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 24 19:21:28.899970 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd546de-d7d2-4735-819d-bb5226ec81bc None None] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:28.900448 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd546de-d7d2-4735-819d-bb5226ec81bc None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:28.900924 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd546de-d7d2-4735-819d-bb5226ec81bc None None] PATH_INFO: `/` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:28.902626 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 171/346] 10.222.0.18 () {54 vars in 927 bytes} [Sat Sep 24 19:21:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:21:28.903550 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd546de-d7d2-4735-819d-bb5226ec81bc None None] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:28.929524 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:28.943524 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bed9685-09a0-46bb-ac81-ff904da05eac None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:28.994000 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac56443-6d84-4813-b361-e9727ff6e854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:28.994536 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac56443-6d84-4813-b361-e9727ff6e854 None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:28.994816 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac56443-6d84-4813-b361-e9727ff6e854 None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:28.995089 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac56443-6d84-4813-b361-e9727ff6e854 None admin] PATH_INFO: `/v3/roles` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:28.996058 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac56443-6d84-4813-b361-e9727ff6e854 None admin] RBAC: Adding query filter params (name=member) {{(pid=88080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:21:28.996371 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac56443-6d84-4813-b361-e9727ff6e854 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:29.003309 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac56443-6d84-4813-b361-e9727ff6e854 None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:29.015868 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 176/347] 10.222.0.18 () {56 vars in 1101 bytes} [Sat Sep 24 19:21:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:21:29.022743 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac56443-6d84-4813-b361-e9727ff6e854 None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:29.038493 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd546de-d7d2-4735-819d-bb5226ec81bc None None] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:29.081457 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229169c4-7fec-4ddf-a807-10f0b8774606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:29.082503 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229169c4-7fec-4ddf-a807-10f0b8774606 None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:29.082979 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229169c4-7fec-4ddf-a807-10f0b8774606 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:29.083444 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229169c4-7fec-4ddf-a807-10f0b8774606 None admin] PATH_INFO: `/v3/roles` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:29.084307 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229169c4-7fec-4ddf-a807-10f0b8774606 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:21:29.084832 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229169c4-7fec-4ddf-a807-10f0b8774606 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:29.086555 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229169c4-7fec-4ddf-a807-10f0b8774606 None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:29.097202 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 172/348] 10.222.0.18 () {56 vars in 1101 bytes} [Sat Sep 24 19:21:28 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:21:29.103464 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:29.104274 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2c0719-4fd0-40ff-bd6b-f15f99a83b0d None None] REQUEST_METHOD: `POST` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:29.104817 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2c0719-4fd0-40ff-bd6b-f15f99a83b0d None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:29.105303 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2c0719-4fd0-40ff-bd6b-f15f99a83b0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:29.128961 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.auth.core [None req-da2c0719-4fd0-40ff-bd6b-f15f99a83b0d None None] MFA Rules not processed for user `3dbbb9909cec43ff99c1c3682f016ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=88081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:21:29.131438 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.fernet_utils [None req-da2c0719-4fd0-40ff-bd6b-f15f99a83b0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:21:29.153187 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac56443-6d84-4813-b361-e9727ff6e854 None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:29.194736 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6984b6ca-1e83-42cf-90f1-47f5255e46d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:29.195394 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6984b6ca-1e83-42cf-90f1-47f5255e46d7 None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:29.195676 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6984b6ca-1e83-42cf-90f1-47f5255e46d7 None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:29.195954 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6984b6ca-1e83-42cf-90f1-47f5255e46d7 None admin] PATH_INFO: `/v3/projects/b7aa834667ed445eba7561ef6fd2d3c6` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:29.197232 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6984b6ca-1e83-42cf-90f1-47f5255e46d7 None admin] RBAC: Authorizing `identity:get_project(project_id=b7aa834667ed445eba7561ef6fd2d3c6)` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:29.198780 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6984b6ca-1e83-42cf-90f1-47f5255e46d7 None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:29.200812 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 177/349] 10.222.0.18 () {56 vars in 1186 bytes} [Sat Sep 24 19:21:29 2022] GET /identity/v3/projects/b7aa834667ed445eba7561ef6fd2d3c6 => generated 298 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:21:29.201920 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6984b6ca-1e83-42cf-90f1-47f5255e46d7 None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:29.234541 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 173/350] 10.222.0.18 () {58 vars in 1024 bytes} [Sat Sep 24 19:21:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:21:29.235293 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2c0719-4fd0-40ff-bd6b-f15f99a83b0d None None] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:29.246680 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:29.325747 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6984b6ca-1e83-42cf-90f1-47f5255e46d7 None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:29.358573 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:29.370988 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54920c9-0b2c-45ba-aa90-3ff529db062d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:29.371911 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54920c9-0b2c-45ba-aa90-3ff529db062d None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:29.372458 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54920c9-0b2c-45ba-aa90-3ff529db062d None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:29.372913 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54920c9-0b2c-45ba-aa90-3ff529db062d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:29.375421 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2c0719-4fd0-40ff-bd6b-f15f99a83b0d None None] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:29.419674 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5215da91-36ef-4ab9-bd07-19f75ba70672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:29.420579 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5215da91-36ef-4ab9-bd07-19f75ba70672 None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:29.421494 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5215da91-36ef-4ab9-bd07-19f75ba70672 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:29.421968 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5215da91-36ef-4ab9-bd07-19f75ba70672 None admin] PATH_INFO: `/v3/users/93fdc7e8c6dd4d79900e6dc3ea0945c4` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:29.423690 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5215da91-36ef-4ab9-bd07-19f75ba70672 None admin] RBAC: Authorizing `identity:get_user(user_id=93fdc7e8c6dd4d79900e6dc3ea0945c4)` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:29.425806 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5215da91-36ef-4ab9-bd07-19f75ba70672 None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:29.428066 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 174/351] 10.222.0.18 () {56 vars in 1177 bytes} [Sat Sep 24 19:21:29 2022] GET /identity/v3/users/93fdc7e8c6dd4d79900e6dc3ea0945c4 => generated 293 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:21:29.429452 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c0e4e0-f806-4186-b5de-1ec6fe23bb20 None None] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:29.434099 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c0e4e0-f806-4186-b5de-1ec6fe23bb20 None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:29.434410 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c0e4e0-f806-4186-b5de-1ec6fe23bb20 None None] PATH_INFO: `/` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:29.435926 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 175/352] 10.222.0.18 () {54 vars in 927 bytes} [Sat Sep 24 19:21:29 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:21:29.436546 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c0e4e0-f806-4186-b5de-1ec6fe23bb20 None None] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:29.466834 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54920c9-0b2c-45ba-aa90-3ff529db062d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:29.469294 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54920c9-0b2c-45ba-aa90-3ff529db062d None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:29.543522 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:29.575812 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c0e4e0-f806-4186-b5de-1ec6fe23bb20 None None] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:29.588389 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 178/353] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Sep 24 19:21:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 24 19:21:29.591387 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54920c9-0b2c-45ba-aa90-3ff529db062d None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:29.624053 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437438e6-5512-444a-97f3-cc31fdd652ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:29.624053 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437438e6-5512-444a-97f3-cc31fdd652ae None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:29.624053 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437438e6-5512-444a-97f3-cc31fdd652ae None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:29.625198 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437438e6-5512-444a-97f3-cc31fdd652ae None admin] PATH_INFO: `/v3/groups/74fc04883e9540a58ba966142053d6ed` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:29.633003 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:29.634769 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437438e6-5512-444a-97f3-cc31fdd652ae None admin] RBAC: Authorizing `identity:get_group(group_id=74fc04883e9540a58ba966142053d6ed)` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:29.636194 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437438e6-5512-444a-97f3-cc31fdd652ae None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:29.638068 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 176/354] 10.222.0.18 () {56 vars in 1180 bytes} [Sat Sep 24 19:21:29 2022] GET /identity/v3/groups/74fc04883e9540a58ba966142053d6ed => generated 226 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:21:29.641853 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d4d79e-99c3-4cee-98df-c8a400cfd908 None None] REQUEST_METHOD: `POST` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:29.641853 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d4d79e-99c3-4cee-98df-c8a400cfd908 None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:29.641853 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d4d79e-99c3-4cee-98df-c8a400cfd908 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:29.670766 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.auth.core [None req-23d4d79e-99c3-4cee-98df-c8a400cfd908 None None] MFA Rules not processed for user `3dbbb9909cec43ff99c1c3682f016ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=88081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:21:29.671959 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.fernet_utils [None req-23d4d79e-99c3-4cee-98df-c8a400cfd908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:21:29.733238 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54920c9-0b2c-45ba-aa90-3ff529db062d None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:29.761041 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 177/355] 10.222.0.18 () {58 vars in 1024 bytes} [Sat Sep 24 19:21:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:21:29.761954 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d4d79e-99c3-4cee-98df-c8a400cfd908 None None] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:29.784876 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8d3b64-c957-462f-8acd-a5074f5c05ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:29.785474 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8d3b64-c957-462f-8acd-a5074f5c05ea None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:29.785747 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8d3b64-c957-462f-8acd-a5074f5c05ea None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:29.786207 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8d3b64-c957-462f-8acd-a5074f5c05ea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:29.786937 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8d3b64-c957-462f-8acd-a5074f5c05ea None admin] RBAC: Adding query filter params (role.id=f072ea6ff7ca4dbf90174c318d19acf1, user.id=93fdc7e8c6dd4d79900e6dc3ea0945c4, scope.system=all) {{(pid=88080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:21:29.787235 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8d3b64-c957-462f-8acd-a5074f5c05ea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:29.788663 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8d3b64-c957-462f-8acd-a5074f5c05ea None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:29.801580 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 179/356] 10.222.0.18 () {56 vars in 1308 bytes} [Sat Sep 24 19:21:29 2022] GET /identity/v3/role_assignments?user.id=93fdc7e8c6dd4d79900e6dc3ea0945c4&scope.system=all&role.id=f072ea6ff7ca4dbf90174c318d19acf1 => generated 510 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:21:29.802361 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8d3b64-c957-462f-8acd-a5074f5c05ea None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:29.848861 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:29.890229 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d4d79e-99c3-4cee-98df-c8a400cfd908 None None] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:29.933574 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:29.937428 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce7aa22-1193-4b55-b8be-a33fa9f9f62a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:29.938582 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce7aa22-1193-4b55-b8be-a33fa9f9f62a None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:29.939013 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce7aa22-1193-4b55-b8be-a33fa9f9f62a None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:29.940959 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce7aa22-1193-4b55-b8be-a33fa9f9f62a None admin] PATH_INFO: `/v3/projects/b7aa834667ed445eba7561ef6fd2d3c6` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:29.942451 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce7aa22-1193-4b55-b8be-a33fa9f9f62a None admin] RBAC: Authorizing `identity:get_project(project_id=b7aa834667ed445eba7561ef6fd2d3c6)` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:29.944296 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce7aa22-1193-4b55-b8be-a33fa9f9f62a None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:29.946271 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 178/357] 10.222.0.18 () {56 vars in 1186 bytes} [Sat Sep 24 19:21:29 2022] GET /identity/v3/projects/b7aa834667ed445eba7561ef6fd2d3c6 => generated 298 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:21:29.947340 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce7aa22-1193-4b55-b8be-a33fa9f9f62a None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:29.954924 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8d3b64-c957-462f-8acd-a5074f5c05ea None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:30.007010 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bedad44-b694-4ce3-afc9-40ac402320f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:30.008707 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bedad44-b694-4ce3-afc9-40ac402320f7 None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:30.010334 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bedad44-b694-4ce3-afc9-40ac402320f7 None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:30.010715 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bedad44-b694-4ce3-afc9-40ac402320f7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:30.025909 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bedad44-b694-4ce3-afc9-40ac402320f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:21:30.033315 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application [None req-0bedad44-b694-4ce3-afc9-40ac402320f7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 24 19:21:30.033315 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:21:30.033315 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:21:30.033315 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:21:30.033315 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:21:30.033315 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:21:30.033315 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:21:30.033315 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:21:30.033315 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:21:30.033315 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:21:30.033315 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:21:30.033315 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:21:30.033315 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:21:30.033315 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:21:30.033315 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:21:30.033315 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:21:30.035067 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:21:30.035067 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:21:30.035067 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:21:30.035067 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:21:30.035067 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:21:30.035067 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:21:30.035067 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:21:30.035067 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:21:30.035067 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:21:30.035067 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:21:30.035067 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:21:30.035067 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application with Lock( Sep 24 19:21:30.035067 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:21:30.035067 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:21:30.035067 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:21:30.035067 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:21:30.036628 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:21:30.036628 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:21:30.036628 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:21:30.036628 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:21:30.036628 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:21:30.036628 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:21:30.036628 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:21:30.036628 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:21:30.036628 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:21:30.036628 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:21:30.036628 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 24 19:21:30.036628 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Sep 24 19:21:30.038399 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 180/358] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Sep 24 19:21:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:21:30.041895 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc27ec74-9fc9-4ba7-8a21-7c0f2a476676 None None] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:30.041895 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc27ec74-9fc9-4ba7-8a21-7c0f2a476676 None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:30.041895 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc27ec74-9fc9-4ba7-8a21-7c0f2a476676 None None] PATH_INFO: `/` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:30.041895 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 181/359] 10.222.0.18 () {54 vars in 927 bytes} [Sat Sep 24 19:21:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:21:30.041895 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc27ec74-9fc9-4ba7-8a21-7c0f2a476676 None None] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:30.154149 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce7aa22-1193-4b55-b8be-a33fa9f9f62a None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:30.171732 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc27ec74-9fc9-4ba7-8a21-7c0f2a476676 None None] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:30.197292 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5978dbc4-3d76-4f65-96d6-413e55b682a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:30.197951 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5978dbc4-3d76-4f65-96d6-413e55b682a9 None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:30.198233 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5978dbc4-3d76-4f65-96d6-413e55b682a9 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:30.198502 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5978dbc4-3d76-4f65-96d6-413e55b682a9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:30.199244 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5978dbc4-3d76-4f65-96d6-413e55b682a9 None admin] RBAC: Adding query filter params (group.id=74fc04883e9540a58ba966142053d6ed, role.id=a24280fb630f4c17865458d833144b17, scope.project.id=b7aa834667ed445eba7561ef6fd2d3c6) {{(pid=88081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:21:30.199535 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5978dbc4-3d76-4f65-96d6-413e55b682a9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:30.200956 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5978dbc4-3d76-4f65-96d6-413e55b682a9 None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:30.207456 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 179/360] 10.222.0.18 () {56 vars in 1376 bytes} [Sat Sep 24 19:21:29 2022] GET /identity/v3/role_assignments?group.id=74fc04883e9540a58ba966142053d6ed&scope.project.id=b7aa834667ed445eba7561ef6fd2d3c6&role.id=a24280fb630f4c17865458d833144b17 => generated 260 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:21:30.208552 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea73332d-023d-4758-b4ba-778fe7855300 None None] REQUEST_METHOD: `POST` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:30.208803 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea73332d-023d-4758-b4ba-778fe7855300 None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:30.209075 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea73332d-023d-4758-b4ba-778fe7855300 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:30.216622 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40e552b-71e3-43b0-a8ad-8d83dddcdd89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:30.217285 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40e552b-71e3-43b0-a8ad-8d83dddcdd89 None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:30.217553 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40e552b-71e3-43b0-a8ad-8d83dddcdd89 None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:30.217880 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40e552b-71e3-43b0-a8ad-8d83dddcdd89 None admin] PATH_INFO: `/v3/groups/74fc04883e9540a58ba966142053d6ed` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:30.219039 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40e552b-71e3-43b0-a8ad-8d83dddcdd89 None admin] RBAC: Authorizing `identity:get_group(group_id=74fc04883e9540a58ba966142053d6ed)` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:30.220476 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40e552b-71e3-43b0-a8ad-8d83dddcdd89 None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:30.222863 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 182/361] 10.222.0.18 () {56 vars in 1180 bytes} [Sat Sep 24 19:21:30 2022] GET /identity/v3/groups/74fc04883e9540a58ba966142053d6ed => generated 226 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:21:30.223639 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40e552b-71e3-43b0-a8ad-8d83dddcdd89 None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:30.224846 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:30.243503 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.auth.core [None req-ea73332d-023d-4758-b4ba-778fe7855300 None None] MFA Rules not processed for user `3dbbb9909cec43ff99c1c3682f016ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=88081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:21:30.244747 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.fernet_utils [None req-ea73332d-023d-4758-b4ba-778fe7855300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:21:30.246631 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:30.338463 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 180/362] 10.222.0.18 () {58 vars in 1024 bytes} [Sat Sep 24 19:21:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:21:30.341316 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea73332d-023d-4758-b4ba-778fe7855300 None None] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:30.383272 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40e552b-71e3-43b0-a8ad-8d83dddcdd89 None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:30.427689 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2b2db0-8072-4c00-8514-e3da39a4244e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:30.428506 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2b2db0-8072-4c00-8514-e3da39a4244e None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:30.428880 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2b2db0-8072-4c00-8514-e3da39a4244e None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:30.429248 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2b2db0-8072-4c00-8514-e3da39a4244e None admin] PATH_INFO: `/v3/roles` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:30.430577 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2b2db0-8072-4c00-8514-e3da39a4244e None admin] RBAC: Adding query filter params (name=member) {{(pid=88080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:21:30.430577 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2b2db0-8072-4c00-8514-e3da39a4244e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:30.432268 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2b2db0-8072-4c00-8514-e3da39a4244e None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:30.446208 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 183/363] 10.222.0.18 () {56 vars in 1101 bytes} [Sat Sep 24 19:21:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:21:30.447288 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2b2db0-8072-4c00-8514-e3da39a4244e None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:30.496047 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea73332d-023d-4758-b4ba-778fe7855300 None None] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:30.529400 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:30.537417 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99754d0-70c2-4180-8c22-46d4bb5fcc80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:30.538092 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99754d0-70c2-4180-8c22-46d4bb5fcc80 None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:30.538372 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99754d0-70c2-4180-8c22-46d4bb5fcc80 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:30.538640 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99754d0-70c2-4180-8c22-46d4bb5fcc80 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:30.543762 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:30.553991 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99754d0-70c2-4180-8c22-46d4bb5fcc80 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:21:30.560554 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application [None req-e99754d0-70c2-4180-8c22-46d4bb5fcc80 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 24 19:21:30.560554 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:21:30.560554 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:21:30.560554 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:21:30.560554 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:21:30.560554 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:21:30.560554 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:21:30.560554 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:21:30.560554 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:21:30.560554 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:21:30.560554 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:21:30.560554 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:21:30.560554 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:21:30.560554 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:21:30.560554 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:21:30.560554 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:21:30.561496 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:21:30.561496 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:21:30.561496 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:21:30.561496 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:21:30.561496 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:21:30.561496 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:21:30.561496 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:21:30.561496 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:21:30.561496 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:21:30.561496 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:21:30.561496 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:21:30.561496 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application with Lock( Sep 24 19:21:30.561496 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:21:30.561496 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:21:30.561496 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:21:30.561496 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:21:30.562470 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:21:30.562470 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:21:30.562470 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:21:30.562470 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:21:30.562470 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:21:30.562470 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:21:30.562470 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:21:30.562470 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:21:30.562470 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:21:30.562470 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:21:30.562470 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 24 19:21:30.562470 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Sep 24 19:21:30.562470 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 181/364] 10.222.0.18 () {56 vars in 1114 bytes} [Sat Sep 24 19:21:30 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:21:30.563173 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99754d0-70c2-4180-8c22-46d4bb5fcc80 None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:30.581057 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2b2db0-8072-4c00-8514-e3da39a4244e None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:30.620080 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89da865a-0ff6-49a3-a165-ef88a516056d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:30.621063 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89da865a-0ff6-49a3-a165-ef88a516056d None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:30.621544 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89da865a-0ff6-49a3-a165-ef88a516056d None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:30.622061 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89da865a-0ff6-49a3-a165-ef88a516056d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:30.622966 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89da865a-0ff6-49a3-a165-ef88a516056d None admin] RBAC: Adding query filter params (group.id=74fc04883e9540a58ba966142053d6ed, role.id=3a42524fc57c4487a34c5c05234413a7, scope.project.id=b7aa834667ed445eba7561ef6fd2d3c6) {{(pid=88080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:21:30.623456 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89da865a-0ff6-49a3-a165-ef88a516056d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:30.625308 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89da865a-0ff6-49a3-a165-ef88a516056d None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:30.633218 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 184/365] 10.222.0.18 () {56 vars in 1376 bytes} [Sat Sep 24 19:21:30 2022] GET /identity/v3/role_assignments?group.id=74fc04883e9540a58ba966142053d6ed&scope.project.id=b7aa834667ed445eba7561ef6fd2d3c6&role.id=3a42524fc57c4487a34c5c05234413a7 => generated 260 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:21:30.634297 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89da865a-0ff6-49a3-a165-ef88a516056d None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:30.685356 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99754d0-70c2-4180-8c22-46d4bb5fcc80 None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:30.733099 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2f5388-db95-4406-8f0e-4dd963f80ad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:30.733740 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2f5388-db95-4406-8f0e-4dd963f80ad7 None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:30.734051 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2f5388-db95-4406-8f0e-4dd963f80ad7 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:30.734321 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2f5388-db95-4406-8f0e-4dd963f80ad7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:30.811963 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:30.813316 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89da865a-0ff6-49a3-a165-ef88a516056d None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:30.824411 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2f5388-db95-4406-8f0e-4dd963f80ad7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:30.827305 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2f5388-db95-4406-8f0e-4dd963f80ad7 None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:30.889870 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db5938a-0471-41ba-8089-05fddf5e8774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:30.891452 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db5938a-0471-41ba-8089-05fddf5e8774 None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:30.892178 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db5938a-0471-41ba-8089-05fddf5e8774 None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:30.892974 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db5938a-0471-41ba-8089-05fddf5e8774 None admin] PATH_INFO: `/v3/roles` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:30.896122 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db5938a-0471-41ba-8089-05fddf5e8774 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:21:30.896953 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db5938a-0471-41ba-8089-05fddf5e8774 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:30.900112 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db5938a-0471-41ba-8089-05fddf5e8774 None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:30.913610 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:30.923470 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 185/366] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Sep 24 19:21:30 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:21:30.925665 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db5938a-0471-41ba-8089-05fddf5e8774 None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:30.953470 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 182/367] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Sep 24 19:21:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 24 19:21:30.958629 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2f5388-db95-4406-8f0e-4dd963f80ad7 None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:31.063541 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:31.077129 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2f5388-db95-4406-8f0e-4dd963f80ad7 None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:31.107459 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db5938a-0471-41ba-8089-05fddf5e8774 None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:31.120029 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9347bb6-d519-4718-9b75-73fee295ce44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:31.122338 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9347bb6-d519-4718-9b75-73fee295ce44 None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:31.122723 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9347bb6-d519-4718-9b75-73fee295ce44 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:31.123249 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9347bb6-d519-4718-9b75-73fee295ce44 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:31.150560 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0152b9-f843-465e-8a49-4b6ffaa47faf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:31.151940 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0152b9-f843-465e-8a49-4b6ffaa47faf None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:31.152317 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0152b9-f843-465e-8a49-4b6ffaa47faf None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:31.152683 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0152b9-f843-465e-8a49-4b6ffaa47faf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:31.169193 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0152b9-f843-465e-8a49-4b6ffaa47faf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:21:31.175307 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application [None req-5a0152b9-f843-465e-8a49-4b6ffaa47faf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 19:21:31.175307 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:21:31.175307 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:21:31.175307 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:21:31.175307 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:21:31.175307 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:21:31.175307 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:21:31.175307 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:21:31.175307 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:21:31.175307 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:21:31.175307 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:21:31.175307 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:21:31.175307 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:21:31.175307 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:21:31.175307 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:21:31.175307 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:21:31.176621 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:21:31.176621 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:21:31.176621 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:21:31.176621 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:21:31.176621 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:21:31.176621 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:21:31.176621 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:21:31.176621 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:21:31.176621 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:21:31.176621 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:21:31.176621 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:21:31.176621 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application with Lock( Sep 24 19:21:31.176621 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:21:31.176621 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:21:31.176621 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:21:31.176621 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:21:31.177570 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:21:31.177570 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:21:31.177570 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:21:31.177570 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:21:31.177570 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:21:31.177570 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:21:31.177570 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:21:31.177570 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:21:31.177570 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:21:31.177570 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:21:31.177570 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 19:21:31.177570 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Sep 24 19:21:31.177570 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 186/368] 10.222.0.18 () {56 vars in 1096 bytes} [Sat Sep 24 19:21:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:21:31.178259 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0152b9-f843-465e-8a49-4b6ffaa47faf None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:31.206765 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9347bb6-d519-4718-9b75-73fee295ce44 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:31.208174 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9347bb6-d519-4718-9b75-73fee295ce44 None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:31.270232 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:31.316147 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0152b9-f843-465e-8a49-4b6ffaa47faf None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:31.328630 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:31.342346 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 183/369] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Sep 24 19:21:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 24 19:21:31.342560 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9347bb6-d519-4718-9b75-73fee295ce44 None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:31.358814 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc66e41e-d4a7-47a8-8d1c-f9db109ace3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:31.359806 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc66e41e-d4a7-47a8-8d1c-f9db109ace3f None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:31.360227 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc66e41e-d4a7-47a8-8d1c-f9db109ace3f None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:31.360658 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc66e41e-d4a7-47a8-8d1c-f9db109ace3f None admin] PATH_INFO: `/v3/projects/b86798f4dc4d4dd79428558b3d00ae1a` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:31.362528 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc66e41e-d4a7-47a8-8d1c-f9db109ace3f None admin] RBAC: Authorizing `identity:get_project(project_id=b86798f4dc4d4dd79428558b3d00ae1a)` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:31.364229 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc66e41e-d4a7-47a8-8d1c-f9db109ace3f None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:31.366626 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 187/370] 10.222.0.18 () {56 vars in 1186 bytes} [Sat Sep 24 19:21:31 2022] GET /identity/v3/projects/b86798f4dc4d4dd79428558b3d00ae1a => generated 302 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:21:31.367614 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc66e41e-d4a7-47a8-8d1c-f9db109ace3f None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:31.460725 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9347bb6-d519-4718-9b75-73fee295ce44 None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:31.487618 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc66e41e-d4a7-47a8-8d1c-f9db109ace3f None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:31.505851 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bd4f87-8935-4052-9e4a-b106de421783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:31.506751 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bd4f87-8935-4052-9e4a-b106de421783 None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:31.507023 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bd4f87-8935-4052-9e4a-b106de421783 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:31.507457 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bd4f87-8935-4052-9e4a-b106de421783 None admin] PATH_INFO: `/v3/roles` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:31.508449 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bd4f87-8935-4052-9e4a-b106de421783 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:21:31.508757 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bd4f87-8935-4052-9e4a-b106de421783 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:31.510163 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bd4f87-8935-4052-9e4a-b106de421783 None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:31.521164 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 184/371] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Sep 24 19:21:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:21:31.521429 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:31.523293 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bd4f87-8935-4052-9e4a-b106de421783 None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:31.532638 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e214bd-d77a-4b0e-8d3a-8e3a64657f82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:31.533421 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e214bd-d77a-4b0e-8d3a-8e3a64657f82 None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:31.533703 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e214bd-d77a-4b0e-8d3a-8e3a64657f82 None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:31.534035 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e214bd-d77a-4b0e-8d3a-8e3a64657f82 None admin] PATH_INFO: `/v3/projects/b86798f4dc4d4dd79428558b3d00ae1a` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:31.535192 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e214bd-d77a-4b0e-8d3a-8e3a64657f82 None admin] RBAC: Authorizing `identity:get_project(project_id=b86798f4dc4d4dd79428558b3d00ae1a)` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:31.536654 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e214bd-d77a-4b0e-8d3a-8e3a64657f82 None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:31.538375 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 188/372] 10.222.0.18 () {56 vars in 1186 bytes} [Sat Sep 24 19:21:31 2022] GET /identity/v3/projects/b86798f4dc4d4dd79428558b3d00ae1a => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:21:31.542647 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e214bd-d77a-4b0e-8d3a-8e3a64657f82 None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:31.603120 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:31.673022 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bd4f87-8935-4052-9e4a-b106de421783 None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:31.685474 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e214bd-d77a-4b0e-8d3a-8e3a64657f82 None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:31.726703 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7c5af4-6873-4241-a9db-74eef881d96e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:31.727630 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7c5af4-6873-4241-a9db-74eef881d96e None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:31.728078 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7c5af4-6873-4241-a9db-74eef881d96e None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:31.728499 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7c5af4-6873-4241-a9db-74eef881d96e None admin] PATH_INFO: `/v3/groups/74fc04883e9540a58ba966142053d6ed` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:31.730077 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7c5af4-6873-4241-a9db-74eef881d96e None admin] RBAC: Authorizing `identity:get_group(group_id=74fc04883e9540a58ba966142053d6ed)` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:31.732813 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7c5af4-6873-4241-a9db-74eef881d96e None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:31.735620 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 185/373] 10.222.0.18 () {56 vars in 1180 bytes} [Sat Sep 24 19:21:31 2022] GET /identity/v3/groups/74fc04883e9540a58ba966142053d6ed => generated 226 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:21:31.736835 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7c5af4-6873-4241-a9db-74eef881d96e None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:31.742877 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562d41f8-9919-48e5-826d-d1b9e69a5205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:31.743510 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562d41f8-9919-48e5-826d-d1b9e69a5205 None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:31.743798 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562d41f8-9919-48e5-826d-d1b9e69a5205 None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:31.744128 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562d41f8-9919-48e5-826d-d1b9e69a5205 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:31.840210 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:31.851447 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562d41f8-9919-48e5-826d-d1b9e69a5205 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:31.852947 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562d41f8-9919-48e5-826d-d1b9e69a5205 None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:31.903490 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7c5af4-6873-4241-a9db-74eef881d96e None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:31.937467 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:31.969872 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d82c42-7aa3-4f58-9a1f-16b04274128c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:31.969872 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d82c42-7aa3-4f58-9a1f-16b04274128c None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:31.969872 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d82c42-7aa3-4f58-9a1f-16b04274128c None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:31.970279 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d82c42-7aa3-4f58-9a1f-16b04274128c None admin] PATH_INFO: `/v3/groups/74fc04883e9540a58ba966142053d6ed` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:31.971852 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d82c42-7aa3-4f58-9a1f-16b04274128c None admin] RBAC: Authorizing `identity:get_group(group_id=74fc04883e9540a58ba966142053d6ed)` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:31.973332 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d82c42-7aa3-4f58-9a1f-16b04274128c None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:31.981811 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 186/374] 10.222.0.18 () {56 vars in 1180 bytes} [Sat Sep 24 19:21:31 2022] GET /identity/v3/groups/74fc04883e9540a58ba966142053d6ed => generated 226 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:21:31.982850 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d82c42-7aa3-4f58-9a1f-16b04274128c None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:32.005912 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 189/375] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Sep 24 19:21:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 24 19:21:32.007111 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562d41f8-9919-48e5-826d-d1b9e69a5205 None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:32.115593 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d82c42-7aa3-4f58-9a1f-16b04274128c None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:32.117039 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:32.125195 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562d41f8-9919-48e5-826d-d1b9e69a5205 None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:32.177636 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60dbd94-fc42-4852-8d53-9320ac54d0f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:32.178295 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01daa29c-66c8-4561-af40-79130b58fdd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:32.178418 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01daa29c-66c8-4561-af40-79130b58fdd4 None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:32.178618 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01daa29c-66c8-4561-af40-79130b58fdd4 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:32.178960 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01daa29c-66c8-4561-af40-79130b58fdd4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:32.179453 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60dbd94-fc42-4852-8d53-9320ac54d0f6 None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:32.179703 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01daa29c-66c8-4561-af40-79130b58fdd4 None admin] RBAC: Adding query filter params (group.id=74fc04883e9540a58ba966142053d6ed, role.id=3a42524fc57c4487a34c5c05234413a7, scope.project.id=b86798f4dc4d4dd79428558b3d00ae1a) {{(pid=88081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:21:32.180017 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01daa29c-66c8-4561-af40-79130b58fdd4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:32.180133 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60dbd94-fc42-4852-8d53-9320ac54d0f6 None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:32.180529 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60dbd94-fc42-4852-8d53-9320ac54d0f6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:32.181396 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60dbd94-fc42-4852-8d53-9320ac54d0f6 None admin] RBAC: Adding query filter params (group.id=74fc04883e9540a58ba966142053d6ed, role.id=a24280fb630f4c17865458d833144b17, scope.project.id=b86798f4dc4d4dd79428558b3d00ae1a) {{(pid=88080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:21:32.181505 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01daa29c-66c8-4561-af40-79130b58fdd4 None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:32.181961 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60dbd94-fc42-4852-8d53-9320ac54d0f6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:32.183660 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60dbd94-fc42-4852-8d53-9320ac54d0f6 None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:32.187768 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 187/376] 10.222.0.18 () {56 vars in 1376 bytes} [Sat Sep 24 19:21:31 2022] GET /identity/v3/role_assignments?group.id=74fc04883e9540a58ba966142053d6ed&scope.project.id=b86798f4dc4d4dd79428558b3d00ae1a&role.id=3a42524fc57c4487a34c5c05234413a7 => generated 260 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:21:32.188642 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01daa29c-66c8-4561-af40-79130b58fdd4 None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:32.191172 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 190/377] 10.222.0.18 () {56 vars in 1376 bytes} [Sat Sep 24 19:21:32 2022] GET /identity/v3/role_assignments?group.id=74fc04883e9540a58ba966142053d6ed&scope.project.id=b86798f4dc4d4dd79428558b3d00ae1a&role.id=a24280fb630f4c17865458d833144b17 => generated 260 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:21:32.286463 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:32.347714 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01daa29c-66c8-4561-af40-79130b58fdd4 None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:32.398702 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fbc6c0-0a51-40e5-9f06-812302246a0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:32.399373 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fbc6c0-0a51-40e5-9f06-812302246a0a None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:32.399652 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fbc6c0-0a51-40e5-9f06-812302246a0a None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:32.399927 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fbc6c0-0a51-40e5-9f06-812302246a0a None admin] PATH_INFO: `/v3/projects/9fc67bd325c24a418945f738b4bd5c71` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:32.401228 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fbc6c0-0a51-40e5-9f06-812302246a0a None admin] RBAC: Authorizing `identity:get_project(project_id=9fc67bd325c24a418945f738b4bd5c71)` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:32.402742 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fbc6c0-0a51-40e5-9f06-812302246a0a None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:32.404694 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 188/378] 10.222.0.18 () {56 vars in 1186 bytes} [Sat Sep 24 19:21:32 2022] GET /identity/v3/projects/9fc67bd325c24a418945f738b4bd5c71 => generated 344 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:21:32.412123 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60dbd94-fc42-4852-8d53-9320ac54d0f6 None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:32.579677 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60dbd94-fc42-4852-8d53-9320ac54d0f6 None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:32.623964 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f60198-25d8-478f-b360-f90dace83cf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:32.624655 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f60198-25d8-478f-b360-f90dace83cf5 None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:32.624966 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f60198-25d8-478f-b360-f90dace83cf5 None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:32.625262 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f60198-25d8-478f-b360-f90dace83cf5 None admin] PATH_INFO: `/v3/groups/749e2f9df4bd44c2acd0bea537441561` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:32.632846 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f60198-25d8-478f-b360-f90dace83cf5 None admin] RBAC: Authorizing `identity:get_group(group_id=749e2f9df4bd44c2acd0bea537441561)` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:32.634434 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f60198-25d8-478f-b360-f90dace83cf5 None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:32.636552 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 191/379] 10.222.0.18 () {56 vars in 1180 bytes} [Sat Sep 24 19:21:32 2022] GET /identity/v3/groups/749e2f9df4bd44c2acd0bea537441561 => generated 229 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:21:32.643152 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fbc6c0-0a51-40e5-9f06-812302246a0a None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:32.792683 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fbc6c0-0a51-40e5-9f06-812302246a0a None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:32.832885 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:32.846468 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a58d9db-422a-4392-89ff-f490df8c7d8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:32.847097 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a58d9db-422a-4392-89ff-f490df8c7d8a None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:32.847370 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a58d9db-422a-4392-89ff-f490df8c7d8a None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:32.847637 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a58d9db-422a-4392-89ff-f490df8c7d8a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:32.848373 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a58d9db-422a-4392-89ff-f490df8c7d8a None admin] RBAC: Adding query filter params (group.id=749e2f9df4bd44c2acd0bea537441561, role.id=4c7d0dafc19b4b0a9821be6ec0da0a8f, scope.project.id=9fc67bd325c24a418945f738b4bd5c71) {{(pid=88081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:21:32.848680 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a58d9db-422a-4392-89ff-f490df8c7d8a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:32.850196 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a58d9db-422a-4392-89ff-f490df8c7d8a None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:32.860139 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 189/380] 10.222.0.18 () {56 vars in 1376 bytes} [Sat Sep 24 19:21:32 2022] GET /identity/v3/role_assignments?group.id=749e2f9df4bd44c2acd0bea537441561&scope.project.id=9fc67bd325c24a418945f738b4bd5c71&role.id=4c7d0dafc19b4b0a9821be6ec0da0a8f => generated 260 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:21:33.344096 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a222ffbc-97ad-476a-afc8-45a235b5f626 None None] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:33.344607 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a222ffbc-97ad-476a-afc8-45a235b5f626 None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:33.344681 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a222ffbc-97ad-476a-afc8-45a235b5f626 None None] PATH_INFO: `/` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:33.346813 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 192/381] 10.222.0.18 () {54 vars in 927 bytes} [Sat Sep 24 19:21:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:21:33.352556 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15997da8-3e68-45f3-a193-a3ecc8ef395a None None] REQUEST_METHOD: `POST` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:33.353040 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15997da8-3e68-45f3-a193-a3ecc8ef395a None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:33.353113 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15997da8-3e68-45f3-a193-a3ecc8ef395a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:33.378883 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.auth.core [None req-15997da8-3e68-45f3-a193-a3ecc8ef395a None None] MFA Rules not processed for user `3dbbb9909cec43ff99c1c3682f016ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=88081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:21:33.380069 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.fernet_utils [None req-15997da8-3e68-45f3-a193-a3ecc8ef395a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:21:33.472717 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 190/382] 10.222.0.18 () {58 vars in 1024 bytes} [Sat Sep 24 19:21:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:21:33.762929 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f85ad2b-7d3e-4366-8208-8fef6aaee9de None None] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:33.763485 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f85ad2b-7d3e-4366-8208-8fef6aaee9de None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:33.763982 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f85ad2b-7d3e-4366-8208-8fef6aaee9de None None] PATH_INFO: `/` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:33.765750 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 193/383] 10.222.0.18 () {54 vars in 927 bytes} [Sat Sep 24 19:21:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:21:33.777110 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43ba4af-bdd3-4075-8e4b-a34275f18de8 None None] REQUEST_METHOD: `POST` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:33.777415 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43ba4af-bdd3-4075-8e4b-a34275f18de8 None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:33.777650 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43ba4af-bdd3-4075-8e4b-a34275f18de8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:33.803851 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.auth.core [None req-f43ba4af-bdd3-4075-8e4b-a34275f18de8 None None] MFA Rules not processed for user `3dbbb9909cec43ff99c1c3682f016ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=88081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:21:33.805033 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.fernet_utils [None req-f43ba4af-bdd3-4075-8e4b-a34275f18de8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:21:33.887179 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 191/384] 10.222.0.18 () {58 vars in 1024 bytes} [Sat Sep 24 19:21:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:21:34.070569 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f85ad2b-7d3e-4366-8208-8fef6aaee9de None None] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:34.102872 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:34.202968 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f85ad2b-7d3e-4366-8208-8fef6aaee9de None None] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:34.240934 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36effba5-dfc0-427c-b66f-d80140b561a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:34.241822 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36effba5-dfc0-427c-b66f-d80140b561a1 None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:34.242115 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36effba5-dfc0-427c-b66f-d80140b561a1 None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:34.242382 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36effba5-dfc0-427c-b66f-d80140b561a1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:34.253747 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36effba5-dfc0-427c-b66f-d80140b561a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:21:34.259041 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application [None req-36effba5-dfc0-427c-b66f-d80140b561a1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 24 19:21:34.259041 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:21:34.259041 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:21:34.259041 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:21:34.259041 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:21:34.259041 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:21:34.259041 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:21:34.259041 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:21:34.259041 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:21:34.259041 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:21:34.259041 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:21:34.259041 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:21:34.259041 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:21:34.259041 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:21:34.259041 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:21:34.259041 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:21:34.260042 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:21:34.260042 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:21:34.260042 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:21:34.260042 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:21:34.260042 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:21:34.260042 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:21:34.260042 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:21:34.260042 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:21:34.260042 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:21:34.260042 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:21:34.260042 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:21:34.260042 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application with Lock( Sep 24 19:21:34.260042 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:21:34.260042 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:21:34.260042 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:21:34.260042 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:21:34.260927 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:21:34.260927 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:21:34.260927 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:21:34.260927 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:21:34.260927 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:21:34.260927 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:21:34.260927 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:21:34.260927 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:21:34.260927 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:21:34.260927 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:21:34.260927 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 24 19:21:34.260927 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Sep 24 19:21:34.260927 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 194/385] 10.222.0.18 () {56 vars in 1114 bytes} [Sat Sep 24 19:21:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:21:34.266282 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43ba4af-bdd3-4075-8e4b-a34275f18de8 None None] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:34.328593 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:34.362118 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36effba5-dfc0-427c-b66f-d80140b561a1 None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:34.403893 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43ba4af-bdd3-4075-8e4b-a34275f18de8 None None] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:34.476790 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce319d6-12ac-4f38-8a03-54b6b2042d6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:34.477867 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce319d6-12ac-4f38-8a03-54b6b2042d6d None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:34.478407 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce319d6-12ac-4f38-8a03-54b6b2042d6d None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:34.478903 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce319d6-12ac-4f38-8a03-54b6b2042d6d None admin] PATH_INFO: `/v3/roles` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:34.479851 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce319d6-12ac-4f38-8a03-54b6b2042d6d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:21:34.480422 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce319d6-12ac-4f38-8a03-54b6b2042d6d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:34.482822 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce319d6-12ac-4f38-8a03-54b6b2042d6d None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:34.500038 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:34.504702 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 192/386] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Sep 24 19:21:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:21:34.510944 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce319d6-12ac-4f38-8a03-54b6b2042d6d None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:34.530698 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36effba5-dfc0-427c-b66f-d80140b561a1 None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:34.602878 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2205aa56-03c3-4a68-a287-39f30bcfe1be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:34.603551 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2205aa56-03c3-4a68-a287-39f30bcfe1be None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:34.603920 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2205aa56-03c3-4a68-a287-39f30bcfe1be None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:34.604194 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2205aa56-03c3-4a68-a287-39f30bcfe1be None admin] PATH_INFO: `/v3/roles/member` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:34.638825 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2205aa56-03c3-4a68-a287-39f30bcfe1be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:21:34.648194 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application [None req-2205aa56-03c3-4a68-a287-39f30bcfe1be None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 24 19:21:34.648194 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:21:34.648194 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:21:34.648194 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:21:34.648194 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:21:34.648194 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:21:34.648194 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:21:34.648194 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:21:34.648194 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:21:34.648194 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:21:34.648194 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:21:34.648194 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:21:34.648194 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:21:34.648194 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:21:34.648194 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:21:34.648194 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:21:34.649224 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:21:34.649224 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:21:34.649224 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:21:34.649224 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:21:34.649224 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:21:34.649224 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:21:34.649224 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:21:34.649224 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:21:34.649224 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:21:34.649224 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:21:34.649224 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:21:34.649224 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application with Lock( Sep 24 19:21:34.649224 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:21:34.649224 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:21:34.649224 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:21:34.649224 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:21:34.650162 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:21:34.650162 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:21:34.650162 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:21:34.650162 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:21:34.650162 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:21:34.650162 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:21:34.650162 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:21:34.650162 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:21:34.650162 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:21:34.650162 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:21:34.650162 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 24 19:21:34.650162 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Sep 24 19:21:34.657384 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 195/387] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Sep 24 19:21:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 19:21:34.668203 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2205aa56-03c3-4a68-a287-39f30bcfe1be None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:34.717864 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce319d6-12ac-4f38-8a03-54b6b2042d6d None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:34.736551 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:34.794800 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351fe3b4-c842-45b5-a17c-a201098b2662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:34.796570 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351fe3b4-c842-45b5-a17c-a201098b2662 None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:34.798340 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351fe3b4-c842-45b5-a17c-a201098b2662 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:34.798816 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351fe3b4-c842-45b5-a17c-a201098b2662 None admin] PATH_INFO: `/v3/groups/74fc04883e9540a58ba966142053d6ed` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:34.801474 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351fe3b4-c842-45b5-a17c-a201098b2662 None admin] RBAC: Authorizing `identity:get_group(group_id=74fc04883e9540a58ba966142053d6ed)` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:34.803238 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351fe3b4-c842-45b5-a17c-a201098b2662 None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:34.809061 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 193/388] 10.222.0.18 () {56 vars in 1180 bytes} [Sat Sep 24 19:21:34 2022] GET /identity/v3/groups/74fc04883e9540a58ba966142053d6ed => generated 226 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:21:34.812518 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351fe3b4-c842-45b5-a17c-a201098b2662 None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:34.865961 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2205aa56-03c3-4a68-a287-39f30bcfe1be None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:34.958129 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351fe3b4-c842-45b5-a17c-a201098b2662 None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:34.966636 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27783912-4b6a-4c9d-8eb3-3f63dbcf98a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:34.967270 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27783912-4b6a-4c9d-8eb3-3f63dbcf98a8 None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:34.967552 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27783912-4b6a-4c9d-8eb3-3f63dbcf98a8 None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:34.967824 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27783912-4b6a-4c9d-8eb3-3f63dbcf98a8 None admin] PATH_INFO: `/v3/roles` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:34.968505 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27783912-4b6a-4c9d-8eb3-3f63dbcf98a8 None admin] RBAC: Adding query filter params (name=member) {{(pid=88080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:21:34.968807 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27783912-4b6a-4c9d-8eb3-3f63dbcf98a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:34.970284 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27783912-4b6a-4c9d-8eb3-3f63dbcf98a8 None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:34.985817 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 196/389] 10.222.0.18 () {56 vars in 1101 bytes} [Sat Sep 24 19:21:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:21:35.002609 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27783912-4b6a-4c9d-8eb3-3f63dbcf98a8 None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:35.010623 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abe99ba-374b-47d8-b6f9-ff63709c8b04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:35.011361 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abe99ba-374b-47d8-b6f9-ff63709c8b04 None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:35.011674 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abe99ba-374b-47d8-b6f9-ff63709c8b04 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:35.011984 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abe99ba-374b-47d8-b6f9-ff63709c8b04 None admin] PATH_INFO: `/v3/projects/b7aa834667ed445eba7561ef6fd2d3c6` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:35.013136 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abe99ba-374b-47d8-b6f9-ff63709c8b04 None admin] RBAC: Authorizing `identity:get_project(project_id=b7aa834667ed445eba7561ef6fd2d3c6)` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:35.014696 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abe99ba-374b-47d8-b6f9-ff63709c8b04 None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:35.016810 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 194/390] 10.222.0.18 () {56 vars in 1186 bytes} [Sat Sep 24 19:21:34 2022] GET /identity/v3/projects/b7aa834667ed445eba7561ef6fd2d3c6 => generated 298 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:21:35.023238 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:35.023407 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abe99ba-374b-47d8-b6f9-ff63709c8b04 None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:35.072508 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:35.136277 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abe99ba-374b-47d8-b6f9-ff63709c8b04 None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:35.176628 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3c20b3-c4db-420f-a12e-53f0a9f9cc16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:35.177558 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3c20b3-c4db-420f-a12e-53f0a9f9cc16 None admin] REQUEST_METHOD: `PUT` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:35.178012 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3c20b3-c4db-420f-a12e-53f0a9f9cc16 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:35.178446 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3c20b3-c4db-420f-a12e-53f0a9f9cc16 None admin] PATH_INFO: `/v3/projects/b7aa834667ed445eba7561ef6fd2d3c6/groups/74fc04883e9540a58ba966142053d6ed/roles/a24280fb630f4c17865458d833144b17` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:35.180903 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3c20b3-c4db-420f-a12e-53f0a9f9cc16 None admin] RBAC: Authorizing `identity:create_grant(project_id=b7aa834667ed445eba7561ef6fd2d3c6, group_id=74fc04883e9540a58ba966142053d6ed, role_id=a24280fb630f4c17865458d833144b17)` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:35.182617 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3c20b3-c4db-420f-a12e-53f0a9f9cc16 None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:35.198519 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 195/391] 10.222.0.18 () {58 vars in 1442 bytes} [Sat Sep 24 19:21:35 2022] PUT /identity/v3/projects/b7aa834667ed445eba7561ef6fd2d3c6/groups/74fc04883e9540a58ba966142053d6ed/roles/a24280fb630f4c17865458d833144b17 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 24 19:21:35.267747 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27783912-4b6a-4c9d-8eb3-3f63dbcf98a8 None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:35.306990 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f90836-0436-4088-a1cd-76002a363cec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:35.307883 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f90836-0436-4088-a1cd-76002a363cec None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:35.308301 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f90836-0436-4088-a1cd-76002a363cec None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:35.308707 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f90836-0436-4088-a1cd-76002a363cec None admin] PATH_INFO: `/v3/groups/74fc04883e9540a58ba966142053d6ed` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:35.310215 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f90836-0436-4088-a1cd-76002a363cec None admin] RBAC: Authorizing `identity:get_group(group_id=74fc04883e9540a58ba966142053d6ed)` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:35.311906 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f90836-0436-4088-a1cd-76002a363cec None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:35.313936 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 197/392] 10.222.0.18 () {56 vars in 1180 bytes} [Sat Sep 24 19:21:35 2022] GET /identity/v3/groups/74fc04883e9540a58ba966142053d6ed => generated 226 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:21:35.320460 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3c20b3-c4db-420f-a12e-53f0a9f9cc16 None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:35.433851 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3c20b3-c4db-420f-a12e-53f0a9f9cc16 None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:35.438218 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:35.473376 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5b23d0-0b53-4394-9c9d-14a0c17a4b00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:35.474525 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5b23d0-0b53-4394-9c9d-14a0c17a4b00 None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:35.475175 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5b23d0-0b53-4394-9c9d-14a0c17a4b00 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:35.475941 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5b23d0-0b53-4394-9c9d-14a0c17a4b00 None admin] PATH_INFO: `/v3/projects/b7aa834667ed445eba7561ef6fd2d3c6` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:35.477170 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5b23d0-0b53-4394-9c9d-14a0c17a4b00 None admin] RBAC: Authorizing `identity:get_project(project_id=b7aa834667ed445eba7561ef6fd2d3c6)` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:35.478695 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5b23d0-0b53-4394-9c9d-14a0c17a4b00 None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:35.480635 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 196/393] 10.222.0.18 () {56 vars in 1186 bytes} [Sat Sep 24 19:21:35 2022] GET /identity/v3/projects/b7aa834667ed445eba7561ef6fd2d3c6 => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:21:35.488080 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f90836-0436-4088-a1cd-76002a363cec None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:35.580227 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:35.609158 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9021bde9-cdf5-4781-9e9b-2847a91c6707 None None] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:35.609610 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9021bde9-cdf5-4781-9e9b-2847a91c6707 None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:35.609914 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9021bde9-cdf5-4781-9e9b-2847a91c6707 None None] PATH_INFO: `/` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:35.613152 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 197/394] 10.222.0.18 () {54 vars in 927 bytes} [Sat Sep 24 19:21:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 24 19:21:35.615171 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f90836-0436-4088-a1cd-76002a363cec None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:35.627584 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e440b9-3b95-4fef-bcd9-63e088890bf1 None None] REQUEST_METHOD: `POST` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:35.628241 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e440b9-3b95-4fef-bcd9-63e088890bf1 None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:35.628736 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e440b9-3b95-4fef-bcd9-63e088890bf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:35.650147 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.auth.core [None req-06e440b9-3b95-4fef-bcd9-63e088890bf1 None None] MFA Rules not processed for user `3dbbb9909cec43ff99c1c3682f016ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=88081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:21:35.651834 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.fernet_utils [None req-06e440b9-3b95-4fef-bcd9-63e088890bf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:21:35.652995 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816a521e-12de-4960-bab8-b334df6bb5a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:35.653659 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816a521e-12de-4960-bab8-b334df6bb5a7 None admin] REQUEST_METHOD: `PUT` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:35.653955 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816a521e-12de-4960-bab8-b334df6bb5a7 None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:35.654224 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816a521e-12de-4960-bab8-b334df6bb5a7 None admin] PATH_INFO: `/v3/projects/b7aa834667ed445eba7561ef6fd2d3c6/groups/74fc04883e9540a58ba966142053d6ed/roles/3a42524fc57c4487a34c5c05234413a7` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:35.656553 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816a521e-12de-4960-bab8-b334df6bb5a7 None admin] RBAC: Authorizing `identity:create_grant(project_id=b7aa834667ed445eba7561ef6fd2d3c6, group_id=74fc04883e9540a58ba966142053d6ed, role_id=3a42524fc57c4487a34c5c05234413a7)` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:35.657750 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816a521e-12de-4960-bab8-b334df6bb5a7 None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:35.675712 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 198/395] 10.222.0.18 () {58 vars in 1442 bytes} [Sat Sep 24 19:21:35 2022] PUT /identity/v3/projects/b7aa834667ed445eba7561ef6fd2d3c6/groups/74fc04883e9540a58ba966142053d6ed/roles/3a42524fc57c4487a34c5c05234413a7 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:21:35.754272 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 198/396] 10.222.0.18 () {58 vars in 1024 bytes} [Sat Sep 24 19:21:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:21:35.793908 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1e9638-a9d9-4d99-a689-8b7ad8b71829 None None] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:35.794352 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1e9638-a9d9-4d99-a689-8b7ad8b71829 None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:35.794760 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1e9638-a9d9-4d99-a689-8b7ad8b71829 None None] PATH_INFO: `/` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:35.796311 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 199/397] 10.222.0.18 () {54 vars in 927 bytes} [Sat Sep 24 19:21:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:21:35.802859 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb1fffe-5893-4028-99d9-4924e7f90f80 None None] REQUEST_METHOD: `POST` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:35.803147 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb1fffe-5893-4028-99d9-4924e7f90f80 None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:35.803415 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb1fffe-5893-4028-99d9-4924e7f90f80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:35.829630 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.auth.core [None req-feb1fffe-5893-4028-99d9-4924e7f90f80 None None] MFA Rules not processed for user `3dbbb9909cec43ff99c1c3682f016ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=88081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:21:35.831418 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.fernet_utils [None req-feb1fffe-5893-4028-99d9-4924e7f90f80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:21:35.928668 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 199/398] 10.222.0.18 () {58 vars in 1024 bytes} [Sat Sep 24 19:21:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:21:36.060621 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbf6fda-20ef-4857-9fed-b18c1425e33d None None] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:36.060868 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbf6fda-20ef-4857-9fed-b18c1425e33d None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:36.061146 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbf6fda-20ef-4857-9fed-b18c1425e33d None None] PATH_INFO: `/` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:36.062828 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 200/399] 10.222.0.18 () {54 vars in 927 bytes} [Sat Sep 24 19:21:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:21:36.068723 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4911930-51b9-4b0f-a063-c5a0248a8e7a None None] REQUEST_METHOD: `POST` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:36.069288 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4911930-51b9-4b0f-a063-c5a0248a8e7a None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:36.069758 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4911930-51b9-4b0f-a063-c5a0248a8e7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:36.089672 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.auth.core [None req-b4911930-51b9-4b0f-a063-c5a0248a8e7a None None] MFA Rules not processed for user `3dbbb9909cec43ff99c1c3682f016ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=88081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:21:36.091246 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.fernet_utils [None req-b4911930-51b9-4b0f-a063-c5a0248a8e7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:21:36.128039 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:36.181392 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbf6fda-20ef-4857-9fed-b18c1425e33d None None] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:36.183849 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 200/400] 10.222.0.18 () {58 vars in 1024 bytes} [Sat Sep 24 19:21:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:21:36.312288 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbf6fda-20ef-4857-9fed-b18c1425e33d None None] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:36.349715 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9055c11-e183-4fe4-be3a-e0fcbdb92be7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:36.350740 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9055c11-e183-4fe4-be3a-e0fcbdb92be7 None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:36.351217 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9055c11-e183-4fe4-be3a-e0fcbdb92be7 None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:36.351712 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9055c11-e183-4fe4-be3a-e0fcbdb92be7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:36.354244 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:36.355102 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4911930-51b9-4b0f-a063-c5a0248a8e7a None None] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:36.366607 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9055c11-e183-4fe4-be3a-e0fcbdb92be7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:21:36.378177 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application [None req-e9055c11-e183-4fe4-be3a-e0fcbdb92be7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 24 19:21:36.378177 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:21:36.378177 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:21:36.378177 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:21:36.378177 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:21:36.378177 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:21:36.378177 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:21:36.378177 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:21:36.378177 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:21:36.378177 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:21:36.378177 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:21:36.378177 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:21:36.378177 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:21:36.378177 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:21:36.378177 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:21:36.378177 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:21:36.379139 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:21:36.379139 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:21:36.379139 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:21:36.379139 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:21:36.379139 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:21:36.379139 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:21:36.379139 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:21:36.379139 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:21:36.379139 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:21:36.379139 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:21:36.379139 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:21:36.379139 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application with Lock( Sep 24 19:21:36.379139 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:21:36.379139 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:21:36.379139 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:21:36.379139 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:21:36.380382 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:21:36.380382 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:21:36.380382 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:21:36.380382 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:21:36.380382 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:21:36.380382 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:21:36.380382 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:21:36.380382 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:21:36.380382 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:21:36.380382 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:21:36.380382 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 24 19:21:36.380382 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Sep 24 19:21:36.380382 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 201/401] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Sep 24 19:21:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:21:36.390380 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9055c11-e183-4fe4-be3a-e0fcbdb92be7 None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:36.556949 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4911930-51b9-4b0f-a063-c5a0248a8e7a None None] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:36.564843 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9055c11-e183-4fe4-be3a-e0fcbdb92be7 None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:36.606289 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f93421b-64d2-4320-af4a-8bf5689f68c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:36.607044 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f93421b-64d2-4320-af4a-8bf5689f68c3 None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:36.607339 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f93421b-64d2-4320-af4a-8bf5689f68c3 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:36.607606 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f93421b-64d2-4320-af4a-8bf5689f68c3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:36.610771 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c7ab6c-2c45-47a6-8542-150a85de5098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:36.612106 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c7ab6c-2c45-47a6-8542-150a85de5098 None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:36.612576 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c7ab6c-2c45-47a6-8542-150a85de5098 None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:36.613202 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c7ab6c-2c45-47a6-8542-150a85de5098 None admin] PATH_INFO: `/v3/roles` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:36.614385 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c7ab6c-2c45-47a6-8542-150a85de5098 None admin] RBAC: Adding query filter params (name=member) {{(pid=88080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:21:36.614859 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c7ab6c-2c45-47a6-8542-150a85de5098 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:36.617637 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c7ab6c-2c45-47a6-8542-150a85de5098 None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:36.621385 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f93421b-64d2-4320-af4a-8bf5689f68c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:21:36.628025 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 202/402] 10.222.0.18 () {56 vars in 1101 bytes} [Sat Sep 24 19:21:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:21:36.629205 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c7ab6c-2c45-47a6-8542-150a85de5098 None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:36.636084 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application [None req-5f93421b-64d2-4320-af4a-8bf5689f68c3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 24 19:21:36.636084 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:21:36.636084 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:21:36.636084 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:21:36.636084 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:21:36.636084 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:21:36.636084 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:21:36.636084 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:21:36.636084 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:21:36.636084 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:21:36.636084 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:21:36.636084 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:21:36.636084 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:21:36.636084 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:21:36.636084 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:21:36.636084 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:21:36.637048 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:21:36.637048 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:21:36.637048 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:21:36.637048 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:21:36.637048 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:21:36.637048 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:21:36.637048 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:21:36.637048 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:21:36.637048 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:21:36.637048 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:21:36.637048 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:21:36.637048 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application with Lock( Sep 24 19:21:36.637048 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:21:36.637048 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:21:36.637048 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:21:36.637048 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:21:36.644094 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:21:36.644094 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:21:36.644094 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:21:36.644094 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:21:36.644094 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:21:36.644094 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:21:36.644094 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:21:36.644094 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:21:36.644094 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:21:36.644094 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:21:36.644094 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 24 19:21:36.644094 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Sep 24 19:21:36.644094 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 201/403] 10.222.0.18 () {56 vars in 1114 bytes} [Sat Sep 24 19:21:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:21:36.644094 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f93421b-64d2-4320-af4a-8bf5689f68c3 None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:36.672319 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:36.699178 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:36.747263 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c7ab6c-2c45-47a6-8542-150a85de5098 None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:36.773651 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f93421b-64d2-4320-af4a-8bf5689f68c3 None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:36.792724 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c3ddd7-133f-49fe-ad91-73b2d5988f6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:36.793672 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c3ddd7-133f-49fe-ad91-73b2d5988f6f None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:36.794156 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c3ddd7-133f-49fe-ad91-73b2d5988f6f None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:36.794599 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c3ddd7-133f-49fe-ad91-73b2d5988f6f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:36.805889 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c3ddd7-133f-49fe-ad91-73b2d5988f6f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:21:36.811764 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application [None req-48c3ddd7-133f-49fe-ad91-73b2d5988f6f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 19:21:36.811764 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:21:36.811764 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:21:36.811764 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:21:36.811764 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:21:36.811764 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:21:36.811764 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:21:36.811764 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:21:36.811764 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:21:36.811764 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:21:36.811764 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:21:36.811764 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:21:36.811764 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:21:36.811764 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:21:36.811764 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:21:36.811764 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:21:36.812685 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:21:36.812685 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:21:36.812685 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:21:36.812685 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:21:36.812685 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:21:36.812685 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:21:36.812685 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:21:36.812685 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:21:36.812685 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:21:36.812685 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:21:36.812685 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:21:36.812685 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application with Lock( Sep 24 19:21:36.812685 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:21:36.812685 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:21:36.812685 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:21:36.812685 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:21:36.813486 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:21:36.813486 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:21:36.813486 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:21:36.813486 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:21:36.813486 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:21:36.813486 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:21:36.813486 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:21:36.813486 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:21:36.813486 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:21:36.813486 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:21:36.813486 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 19:21:36.813486 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Sep 24 19:21:36.815505 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 203/404] 10.222.0.18 () {56 vars in 1096 bytes} [Sat Sep 24 19:21:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:21:36.817292 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c3ddd7-133f-49fe-ad91-73b2d5988f6f None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:36.818357 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477e7aa7-0b24-472c-a0ed-c04487eb8f75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:36.819310 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477e7aa7-0b24-472c-a0ed-c04487eb8f75 None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:36.819579 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477e7aa7-0b24-472c-a0ed-c04487eb8f75 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:36.820332 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477e7aa7-0b24-472c-a0ed-c04487eb8f75 None admin] PATH_INFO: `/v3/groups/74fc04883e9540a58ba966142053d6ed` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:36.821570 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477e7aa7-0b24-472c-a0ed-c04487eb8f75 None admin] RBAC: Authorizing `identity:get_group(group_id=74fc04883e9540a58ba966142053d6ed)` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:36.823442 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477e7aa7-0b24-472c-a0ed-c04487eb8f75 None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:36.826222 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 202/405] 10.222.0.18 () {56 vars in 1180 bytes} [Sat Sep 24 19:21:36 2022] GET /identity/v3/groups/74fc04883e9540a58ba966142053d6ed => generated 226 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:21:36.830256 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477e7aa7-0b24-472c-a0ed-c04487eb8f75 None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:36.932136 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:36.934261 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c3ddd7-133f-49fe-ad91-73b2d5988f6f None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:36.945052 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477e7aa7-0b24-472c-a0ed-c04487eb8f75 None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:36.951620 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:36.971997 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2509d369-5695-4838-a562-0cb1c4ed957a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:36.972618 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2509d369-5695-4838-a562-0cb1c4ed957a None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:36.972915 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2509d369-5695-4838-a562-0cb1c4ed957a None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:36.973133 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2509d369-5695-4838-a562-0cb1c4ed957a None admin] PATH_INFO: `/v3/roles` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:36.973814 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2509d369-5695-4838-a562-0cb1c4ed957a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:21:36.974176 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2509d369-5695-4838-a562-0cb1c4ed957a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:36.975597 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2509d369-5695-4838-a562-0cb1c4ed957a None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:36.984326 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 204/406] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Sep 24 19:21:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:21:36.986540 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2647e9b-29a2-47f7-8d0f-e8afe96b1104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:36.987587 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2647e9b-29a2-47f7-8d0f-e8afe96b1104 None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:36.988069 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2647e9b-29a2-47f7-8d0f-e8afe96b1104 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:36.988544 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2647e9b-29a2-47f7-8d0f-e8afe96b1104 None admin] PATH_INFO: `/v3/roles` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:36.989408 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2647e9b-29a2-47f7-8d0f-e8afe96b1104 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:21:36.989582 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2509d369-5695-4838-a562-0cb1c4ed957a None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:36.990510 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2647e9b-29a2-47f7-8d0f-e8afe96b1104 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:36.992421 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2647e9b-29a2-47f7-8d0f-e8afe96b1104 None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:37.003496 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 203/407] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Sep 24 19:21:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:21:37.004814 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2647e9b-29a2-47f7-8d0f-e8afe96b1104 None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:37.105905 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2509d369-5695-4838-a562-0cb1c4ed957a None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:37.119012 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2647e9b-29a2-47f7-8d0f-e8afe96b1104 None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:37.143186 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e917eda-6b76-478e-b8fe-d207f7e3b32b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:37.143808 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e917eda-6b76-478e-b8fe-d207f7e3b32b None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:37.144087 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e917eda-6b76-478e-b8fe-d207f7e3b32b None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:37.144367 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e917eda-6b76-478e-b8fe-d207f7e3b32b None admin] PATH_INFO: `/v3/projects/b86798f4dc4d4dd79428558b3d00ae1a` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:37.145472 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e917eda-6b76-478e-b8fe-d207f7e3b32b None admin] RBAC: Authorizing `identity:get_project(project_id=b86798f4dc4d4dd79428558b3d00ae1a)` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:37.146953 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e917eda-6b76-478e-b8fe-d207f7e3b32b None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:37.153227 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 205/408] 10.222.0.18 () {56 vars in 1186 bytes} [Sat Sep 24 19:21:36 2022] GET /identity/v3/projects/b86798f4dc4d4dd79428558b3d00ae1a => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:21:37.153227 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e917eda-6b76-478e-b8fe-d207f7e3b32b None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:37.163797 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8379c9b-0a69-42a3-9554-c970735e93fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:37.164656 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8379c9b-0a69-42a3-9554-c970735e93fb None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:37.165117 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8379c9b-0a69-42a3-9554-c970735e93fb None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:37.165586 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8379c9b-0a69-42a3-9554-c970735e93fb None admin] PATH_INFO: `/v3/groups/74fc04883e9540a58ba966142053d6ed` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:37.166912 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8379c9b-0a69-42a3-9554-c970735e93fb None admin] RBAC: Authorizing `identity:get_group(group_id=74fc04883e9540a58ba966142053d6ed)` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:37.168570 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8379c9b-0a69-42a3-9554-c970735e93fb None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:37.170636 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 204/409] 10.222.0.18 () {56 vars in 1180 bytes} [Sat Sep 24 19:21:37 2022] GET /identity/v3/groups/74fc04883e9540a58ba966142053d6ed => generated 226 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:21:37.171546 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8379c9b-0a69-42a3-9554-c970735e93fb None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:37.204011 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:37.217754 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:37.284384 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e917eda-6b76-478e-b8fe-d207f7e3b32b None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:37.303023 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8379c9b-0a69-42a3-9554-c970735e93fb None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:37.321586 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d14b7d-985b-4450-9602-8cf98c9879ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:37.322258 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d14b7d-985b-4450-9602-8cf98c9879ba None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:37.322531 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d14b7d-985b-4450-9602-8cf98c9879ba None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:37.322796 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d14b7d-985b-4450-9602-8cf98c9879ba None admin] PATH_INFO: `/v3/groups/749e2f9df4bd44c2acd0bea537441561` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:37.324177 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d14b7d-985b-4450-9602-8cf98c9879ba None admin] RBAC: Authorizing `identity:get_group(group_id=749e2f9df4bd44c2acd0bea537441561)` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:37.325716 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d14b7d-985b-4450-9602-8cf98c9879ba None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:37.327649 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 206/410] 10.222.0.18 () {56 vars in 1180 bytes} [Sat Sep 24 19:21:37 2022] GET /identity/v3/groups/749e2f9df4bd44c2acd0bea537441561 => generated 229 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:21:37.328614 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d14b7d-985b-4450-9602-8cf98c9879ba None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:37.341298 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb9d17a-999c-44e0-a39b-c6edb1f39037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:37.342314 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb9d17a-999c-44e0-a39b-c6edb1f39037 None admin] REQUEST_METHOD: `PUT` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:37.342809 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb9d17a-999c-44e0-a39b-c6edb1f39037 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:37.343297 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb9d17a-999c-44e0-a39b-c6edb1f39037 None admin] PATH_INFO: `/v3/projects/b86798f4dc4d4dd79428558b3d00ae1a/groups/74fc04883e9540a58ba966142053d6ed/roles/3a42524fc57c4487a34c5c05234413a7` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:37.345453 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb9d17a-999c-44e0-a39b-c6edb1f39037 None admin] RBAC: Authorizing `identity:create_grant(project_id=b86798f4dc4d4dd79428558b3d00ae1a, group_id=74fc04883e9540a58ba966142053d6ed, role_id=3a42524fc57c4487a34c5c05234413a7)` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:37.347211 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb9d17a-999c-44e0-a39b-c6edb1f39037 None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:37.370083 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 205/411] 10.222.0.18 () {58 vars in 1442 bytes} [Sat Sep 24 19:21:37 2022] PUT /identity/v3/projects/b86798f4dc4d4dd79428558b3d00ae1a/groups/74fc04883e9540a58ba966142053d6ed/roles/3a42524fc57c4487a34c5c05234413a7 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:21:37.371375 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb9d17a-999c-44e0-a39b-c6edb1f39037 None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:37.454192 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d14b7d-985b-4450-9602-8cf98c9879ba None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:37.466165 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:37.491616 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccc0558-a3ab-4088-8449-e9eef998865e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:37.492636 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccc0558-a3ab-4088-8449-e9eef998865e None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:37.493127 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccc0558-a3ab-4088-8449-e9eef998865e None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:37.493598 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccc0558-a3ab-4088-8449-e9eef998865e None admin] PATH_INFO: `/v3/projects/b86798f4dc4d4dd79428558b3d00ae1a` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:37.495034 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccc0558-a3ab-4088-8449-e9eef998865e None admin] RBAC: Authorizing `identity:get_project(project_id=b86798f4dc4d4dd79428558b3d00ae1a)` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:37.496795 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccc0558-a3ab-4088-8449-e9eef998865e None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:37.502238 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 207/412] 10.222.0.18 () {56 vars in 1186 bytes} [Sat Sep 24 19:21:37 2022] GET /identity/v3/projects/b86798f4dc4d4dd79428558b3d00ae1a => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:21:37.506182 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccc0558-a3ab-4088-8449-e9eef998865e None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:37.551930 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:37.595046 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb9d17a-999c-44e0-a39b-c6edb1f39037 None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:37.639222 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccc0558-a3ab-4088-8449-e9eef998865e None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:37.655611 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2373b6-81a2-40bc-b91f-a571215b7122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:37.656263 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2373b6-81a2-40bc-b91f-a571215b7122 None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:37.656546 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2373b6-81a2-40bc-b91f-a571215b7122 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:37.656886 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2373b6-81a2-40bc-b91f-a571215b7122 None admin] PATH_INFO: `/v3/projects/9fc67bd325c24a418945f738b4bd5c71` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:37.658541 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2373b6-81a2-40bc-b91f-a571215b7122 None admin] RBAC: Authorizing `identity:get_project(project_id=9fc67bd325c24a418945f738b4bd5c71)` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:37.660006 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2373b6-81a2-40bc-b91f-a571215b7122 None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:37.663298 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 206/413] 10.222.0.18 () {56 vars in 1186 bytes} [Sat Sep 24 19:21:37 2022] GET /identity/v3/projects/9fc67bd325c24a418945f738b4bd5c71 => generated 344 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:21:37.670459 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2373b6-81a2-40bc-b91f-a571215b7122 None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:37.719336 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796c720e-c150-486d-8953-4a73c0ef6deb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:37.721186 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796c720e-c150-486d-8953-4a73c0ef6deb None admin] REQUEST_METHOD: `PUT` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:37.722092 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796c720e-c150-486d-8953-4a73c0ef6deb None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:37.722582 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796c720e-c150-486d-8953-4a73c0ef6deb None admin] PATH_INFO: `/v3/projects/b86798f4dc4d4dd79428558b3d00ae1a/groups/74fc04883e9540a58ba966142053d6ed/roles/a24280fb630f4c17865458d833144b17` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:37.725763 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796c720e-c150-486d-8953-4a73c0ef6deb None admin] RBAC: Authorizing `identity:create_grant(project_id=b86798f4dc4d4dd79428558b3d00ae1a, group_id=74fc04883e9540a58ba966142053d6ed, role_id=a24280fb630f4c17865458d833144b17)` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:37.727947 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796c720e-c150-486d-8953-4a73c0ef6deb None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:37.754494 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 208/414] 10.222.0.18 () {58 vars in 1442 bytes} [Sat Sep 24 19:21:37 2022] PUT /identity/v3/projects/b86798f4dc4d4dd79428558b3d00ae1a/groups/74fc04883e9540a58ba966142053d6ed/roles/a24280fb630f4c17865458d833144b17 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 24 19:21:37.816874 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2373b6-81a2-40bc-b91f-a571215b7122 None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:37.859447 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e48639-0ebc-460c-9a57-b39ced233e91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:37.860386 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e48639-0ebc-460c-9a57-b39ced233e91 None admin] REQUEST_METHOD: `PUT` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:37.860872 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e48639-0ebc-460c-9a57-b39ced233e91 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:37.861280 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e48639-0ebc-460c-9a57-b39ced233e91 None admin] PATH_INFO: `/v3/projects/9fc67bd325c24a418945f738b4bd5c71/groups/749e2f9df4bd44c2acd0bea537441561/roles/4c7d0dafc19b4b0a9821be6ec0da0a8f` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:37.863536 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e48639-0ebc-460c-9a57-b39ced233e91 None admin] RBAC: Authorizing `identity:create_grant(project_id=9fc67bd325c24a418945f738b4bd5c71, group_id=749e2f9df4bd44c2acd0bea537441561, role_id=4c7d0dafc19b4b0a9821be6ec0da0a8f)` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:37.865185 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e48639-0ebc-460c-9a57-b39ced233e91 None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:37.881351 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 207/415] 10.222.0.18 () {58 vars in 1442 bytes} [Sat Sep 24 19:21:37 2022] PUT /identity/v3/projects/9fc67bd325c24a418945f738b4bd5c71/groups/749e2f9df4bd44c2acd0bea537441561/roles/4c7d0dafc19b4b0a9821be6ec0da0a8f => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:21:38.312243 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adde3f98-7e62-485f-bad1-997f6255d3fd None None] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:38.312610 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adde3f98-7e62-485f-bad1-997f6255d3fd None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:38.312782 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adde3f98-7e62-485f-bad1-997f6255d3fd None None] PATH_INFO: `/` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:38.314590 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 209/416] 10.222.0.18 () {54 vars in 927 bytes} [Sat Sep 24 19:21:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:21:38.323512 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b16b6e8-c7d6-4ffd-a784-d67e3c24ede6 None None] REQUEST_METHOD: `POST` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:38.323790 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b16b6e8-c7d6-4ffd-a784-d67e3c24ede6 None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:38.324060 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b16b6e8-c7d6-4ffd-a784-d67e3c24ede6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:38.343902 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.auth.core [None req-5b16b6e8-c7d6-4ffd-a784-d67e3c24ede6 None None] MFA Rules not processed for user `3dbbb9909cec43ff99c1c3682f016ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=88081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:21:38.345116 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.fernet_utils [None req-5b16b6e8-c7d6-4ffd-a784-d67e3c24ede6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:21:38.347333 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:38.434229 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 208/417] 10.222.0.18 () {58 vars in 1024 bytes} [Sat Sep 24 19:21:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:21:38.628702 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1584df-8162-4b21-81d3-13140af579e2 None None] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:38.628702 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1584df-8162-4b21-81d3-13140af579e2 None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:38.628702 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1584df-8162-4b21-81d3-13140af579e2 None None] PATH_INFO: `/` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:38.629469 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 210/418] 10.222.0.18 () {54 vars in 927 bytes} [Sat Sep 24 19:21:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:21:38.635497 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e20be7c-4b83-443b-8b9f-c2560999f9e1 None None] REQUEST_METHOD: `POST` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:38.635997 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e20be7c-4b83-443b-8b9f-c2560999f9e1 None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:38.636073 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e20be7c-4b83-443b-8b9f-c2560999f9e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:38.666194 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.auth.core [None req-0e20be7c-4b83-443b-8b9f-c2560999f9e1 None None] MFA Rules not processed for user `3dbbb9909cec43ff99c1c3682f016ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=88081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:21:38.667424 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.fernet_utils [None req-0e20be7c-4b83-443b-8b9f-c2560999f9e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:21:38.761878 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 209/419] 10.222.0.18 () {58 vars in 1024 bytes} [Sat Sep 24 19:21:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:21:39.066248 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1584df-8162-4b21-81d3-13140af579e2 None None] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:39.126179 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:39.145258 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e20be7c-4b83-443b-8b9f-c2560999f9e1 None None] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:39.200106 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1584df-8162-4b21-81d3-13140af579e2 None None] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:39.265078 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece249dc-7f6f-48a9-b367-4c851abb473a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:39.265767 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece249dc-7f6f-48a9-b367-4c851abb473a None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:39.266108 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece249dc-7f6f-48a9-b367-4c851abb473a None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:39.266415 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece249dc-7f6f-48a9-b367-4c851abb473a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:39.286525 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece249dc-7f6f-48a9-b367-4c851abb473a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:21:39.294128 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application [None req-ece249dc-7f6f-48a9-b367-4c851abb473a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 24 19:21:39.294128 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:21:39.294128 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:21:39.294128 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:21:39.294128 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:21:39.294128 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:21:39.294128 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:21:39.294128 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:21:39.294128 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:21:39.294128 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:21:39.294128 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:21:39.294128 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:21:39.294128 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:21:39.294128 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:21:39.294128 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:21:39.294128 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:21:39.295757 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:21:39.295757 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:21:39.295757 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:21:39.295757 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:21:39.295757 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:21:39.295757 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:21:39.295757 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:21:39.295757 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:21:39.295757 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:21:39.295757 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:21:39.295757 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:21:39.295757 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application with Lock( Sep 24 19:21:39.295757 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:21:39.295757 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:21:39.295757 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:21:39.295757 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:21:39.298577 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:21:39.298577 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:21:39.298577 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:21:39.298577 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:21:39.298577 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:21:39.298577 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:21:39.298577 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:21:39.298577 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:21:39.298577 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:21:39.298577 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:21:39.298577 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 24 19:21:39.298577 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Sep 24 19:21:39.298577 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 211/420] 10.222.0.18 () {56 vars in 1114 bytes} [Sat Sep 24 19:21:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:21:39.304949 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece249dc-7f6f-48a9-b367-4c851abb473a None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:39.314434 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:39.371966 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e20be7c-4b83-443b-8b9f-c2560999f9e1 None None] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:39.443524 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0160c85-51a2-426c-9e88-f101bc1f7861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:39.444279 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0160c85-51a2-426c-9e88-f101bc1f7861 None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:39.444569 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0160c85-51a2-426c-9e88-f101bc1f7861 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:39.444872 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0160c85-51a2-426c-9e88-f101bc1f7861 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:39.467511 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0160c85-51a2-426c-9e88-f101bc1f7861 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:21:39.474280 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application [None req-b0160c85-51a2-426c-9e88-f101bc1f7861 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 24 19:21:39.474280 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:21:39.474280 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:21:39.474280 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:21:39.474280 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:21:39.474280 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:21:39.474280 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:21:39.474280 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:21:39.474280 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:21:39.474280 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:21:39.474280 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:21:39.474280 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:21:39.474280 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:21:39.474280 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:21:39.474280 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:21:39.474280 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:21:39.477879 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:21:39.477879 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:21:39.477879 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:21:39.477879 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:21:39.477879 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:21:39.477879 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:21:39.477879 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:21:39.477879 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:21:39.477879 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:21:39.477879 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:21:39.477879 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:21:39.477879 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application with Lock( Sep 24 19:21:39.477879 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:21:39.477879 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:21:39.477879 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:21:39.477879 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:21:39.480773 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:21:39.480773 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:21:39.480773 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:21:39.480773 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:21:39.480773 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:21:39.480773 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:21:39.480773 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:21:39.480773 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:21:39.480773 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:21:39.480773 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:21:39.480773 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 24 19:21:39.480773 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Sep 24 19:21:39.480773 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 210/421] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Sep 24 19:21:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 19:21:39.483181 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0160c85-51a2-426c-9e88-f101bc1f7861 None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:39.506016 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece249dc-7f6f-48a9-b367-4c851abb473a None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:39.518950 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:39.547666 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5471ef-621a-41c6-9279-b60da692c025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:39.548416 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5471ef-621a-41c6-9279-b60da692c025 None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:39.548881 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5471ef-621a-41c6-9279-b60da692c025 None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:39.549324 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5471ef-621a-41c6-9279-b60da692c025 None admin] PATH_INFO: `/v3/roles` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:39.550551 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5471ef-621a-41c6-9279-b60da692c025 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:21:39.551019 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5471ef-621a-41c6-9279-b60da692c025 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:39.552452 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5471ef-621a-41c6-9279-b60da692c025 None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:39.566005 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 212/422] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Sep 24 19:21:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:21:39.568157 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5471ef-621a-41c6-9279-b60da692c025 None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:39.679349 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0160c85-51a2-426c-9e88-f101bc1f7861 None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:39.747579 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:39.765860 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2062cee5-08a2-4ac6-921c-ac4894e55fa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:39.765860 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2062cee5-08a2-4ac6-921c-ac4894e55fa5 None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:39.766274 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2062cee5-08a2-4ac6-921c-ac4894e55fa5 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:39.766549 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2062cee5-08a2-4ac6-921c-ac4894e55fa5 None admin] PATH_INFO: `/v3/roles` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:39.768037 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2062cee5-08a2-4ac6-921c-ac4894e55fa5 None admin] RBAC: Adding query filter params (name=member) {{(pid=88081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:21:39.768340 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2062cee5-08a2-4ac6-921c-ac4894e55fa5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:39.772218 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5471ef-621a-41c6-9279-b60da692c025 None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:39.775725 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2062cee5-08a2-4ac6-921c-ac4894e55fa5 None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:39.791737 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 211/423] 10.222.0.18 () {56 vars in 1101 bytes} [Sat Sep 24 19:21:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:21:39.797990 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2062cee5-08a2-4ac6-921c-ac4894e55fa5 None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:39.858764 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9d5962-0663-4ab3-a877-8211530b30e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:39.859384 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9d5962-0663-4ab3-a877-8211530b30e7 None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:39.859655 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9d5962-0663-4ab3-a877-8211530b30e7 None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:39.859919 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9d5962-0663-4ab3-a877-8211530b30e7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:39.940644 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:40.000901 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9d5962-0663-4ab3-a877-8211530b30e7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:40.002983 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9d5962-0663-4ab3-a877-8211530b30e7 None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:40.041251 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2062cee5-08a2-4ac6-921c-ac4894e55fa5 None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:40.130497 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e77c8b-56c0-45cd-b6db-e56eb80ed7b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:40.131191 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e77c8b-56c0-45cd-b6db-e56eb80ed7b3 None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:40.132657 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e77c8b-56c0-45cd-b6db-e56eb80ed7b3 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:40.132955 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e77c8b-56c0-45cd-b6db-e56eb80ed7b3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:40.218053 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 213/424] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Sep 24 19:21:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 650 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 24 19:21:40.233863 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9d5962-0663-4ab3-a877-8211530b30e7 None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:40.265856 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:40.299512 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e77c8b-56c0-45cd-b6db-e56eb80ed7b3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:40.300586 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:40.300979 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e77c8b-56c0-45cd-b6db-e56eb80ed7b3 None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:40.392298 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9d5962-0663-4ab3-a877-8211530b30e7 None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:40.467701 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803b98fb-607d-40d4-be13-bf4449c54bc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:40.468397 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803b98fb-607d-40d4-be13-bf4449c54bc9 None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:40.468616 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803b98fb-607d-40d4-be13-bf4449c54bc9 None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:40.468883 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803b98fb-607d-40d4-be13-bf4449c54bc9 None admin] PATH_INFO: `/v3/projects/b7aa834667ed445eba7561ef6fd2d3c6` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:40.470882 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803b98fb-607d-40d4-be13-bf4449c54bc9 None admin] RBAC: Authorizing `identity:get_project(project_id=b7aa834667ed445eba7561ef6fd2d3c6)` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:40.472325 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803b98fb-607d-40d4-be13-bf4449c54bc9 None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:40.476846 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 214/425] 10.222.0.18 () {56 vars in 1186 bytes} [Sat Sep 24 19:21:40 2022] GET /identity/v3/projects/b7aa834667ed445eba7561ef6fd2d3c6 => generated 298 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:21:40.480962 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803b98fb-607d-40d4-be13-bf4449c54bc9 None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:40.506818 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 212/426] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Sep 24 19:21:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 709 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 24 19:21:40.515766 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e77c8b-56c0-45cd-b6db-e56eb80ed7b3 None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:40.633026 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:40.645409 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e77c8b-56c0-45cd-b6db-e56eb80ed7b3 None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:40.659402 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803b98fb-607d-40d4-be13-bf4449c54bc9 None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:40.683022 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f84a64-e98e-431e-935f-b1ebda9d6d97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:40.684359 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f84a64-e98e-431e-935f-b1ebda9d6d97 None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:40.684950 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f84a64-e98e-431e-935f-b1ebda9d6d97 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:40.685437 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f84a64-e98e-431e-935f-b1ebda9d6d97 None admin] PATH_INFO: `/v3/projects/b7aa834667ed445eba7561ef6fd2d3c6` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:40.686927 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f84a64-e98e-431e-935f-b1ebda9d6d97 None admin] RBAC: Authorizing `identity:get_project(project_id=b7aa834667ed445eba7561ef6fd2d3c6)` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:40.689093 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f84a64-e98e-431e-935f-b1ebda9d6d97 None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:40.691025 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 213/427] 10.222.0.18 () {56 vars in 1186 bytes} [Sat Sep 24 19:21:40 2022] GET /identity/v3/projects/b7aa834667ed445eba7561ef6fd2d3c6 => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:21:40.692463 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500070f3-5ba9-43e3-a8ea-216e89382668 None None] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:40.692953 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500070f3-5ba9-43e3-a8ea-216e89382668 None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:40.693419 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500070f3-5ba9-43e3-a8ea-216e89382668 None None] PATH_INFO: `/` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:40.694939 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 214/428] 10.222.0.18 () {54 vars in 927 bytes} [Sat Sep 24 19:21:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:21:40.699206 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:40.700597 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500070f3-5ba9-43e3-a8ea-216e89382668 None None] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:40.706766 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d8ca82-d112-4c8c-a6b9-0aadb7c5a536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:40.707429 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d8ca82-d112-4c8c-a6b9-0aadb7c5a536 None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:40.707707 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d8ca82-d112-4c8c-a6b9-0aadb7c5a536 None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:40.707979 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d8ca82-d112-4c8c-a6b9-0aadb7c5a536 None admin] PATH_INFO: `/v3/groups/74fc04883e9540a58ba966142053d6ed` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:40.709262 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d8ca82-d112-4c8c-a6b9-0aadb7c5a536 None admin] RBAC: Authorizing `identity:get_group(group_id=74fc04883e9540a58ba966142053d6ed)` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:40.710804 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d8ca82-d112-4c8c-a6b9-0aadb7c5a536 None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:40.712529 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 215/429] 10.222.0.18 () {56 vars in 1180 bytes} [Sat Sep 24 19:21:40 2022] GET /identity/v3/groups/74fc04883e9540a58ba966142053d6ed => generated 226 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:21:40.713776 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a0f5bf-5b05-4865-8ec9-0b24a0fa6fa8 None None] REQUEST_METHOD: `POST` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:40.714236 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a0f5bf-5b05-4865-8ec9-0b24a0fa6fa8 None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:40.714649 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a0f5bf-5b05-4865-8ec9-0b24a0fa6fa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:40.735457 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.auth.core [None req-85a0f5bf-5b05-4865-8ec9-0b24a0fa6fa8 None None] MFA Rules not processed for user `3dbbb9909cec43ff99c1c3682f016ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=88080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:21:40.737342 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.fernet_utils [None req-85a0f5bf-5b05-4865-8ec9-0b24a0fa6fa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:21:40.833159 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 216/430] 10.222.0.18 () {58 vars in 1024 bytes} [Sat Sep 24 19:21:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:21:40.835091 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5288cd-1922-4891-ae48-c42410574197 None None] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:40.835505 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5288cd-1922-4891-ae48-c42410574197 None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:40.836403 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5288cd-1922-4891-ae48-c42410574197 None None] PATH_INFO: `/` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:40.838146 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 217/431] 10.222.0.18 () {54 vars in 927 bytes} [Sat Sep 24 19:21:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:21:40.844189 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5288cd-1922-4891-ae48-c42410574197 None None] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:40.856216 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500070f3-5ba9-43e3-a8ea-216e89382668 None None] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:40.913372 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba34668-46d7-4892-8f30-fc80ecda45ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:40.914166 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba34668-46d7-4892-8f30-fc80ecda45ef None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:40.914439 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba34668-46d7-4892-8f30-fc80ecda45ef None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:40.914967 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba34668-46d7-4892-8f30-fc80ecda45ef None admin] PATH_INFO: `/v3/groups/74fc04883e9540a58ba966142053d6ed` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:40.917581 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba34668-46d7-4892-8f30-fc80ecda45ef None admin] RBAC: Authorizing `identity:get_group(group_id=74fc04883e9540a58ba966142053d6ed)` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:40.923772 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba34668-46d7-4892-8f30-fc80ecda45ef None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:40.926228 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 215/432] 10.222.0.18 () {56 vars in 1180 bytes} [Sat Sep 24 19:21:40 2022] GET /identity/v3/groups/74fc04883e9540a58ba966142053d6ed => generated 226 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:21:40.927759 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c416cee-7177-4662-8a63-ad70f786cc2a None None] REQUEST_METHOD: `POST` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:40.928335 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c416cee-7177-4662-8a63-ad70f786cc2a None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:40.928843 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c416cee-7177-4662-8a63-ad70f786cc2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:40.971249 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.auth.core [None req-2c416cee-7177-4662-8a63-ad70f786cc2a None None] MFA Rules not processed for user `3dbbb9909cec43ff99c1c3682f016ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=88081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:21:40.973364 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.fernet_utils [None req-2c416cee-7177-4662-8a63-ad70f786cc2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:21:41.011898 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:41.052262 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5288cd-1922-4891-ae48-c42410574197 None None] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:41.093640 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 216/433] 10.222.0.18 () {58 vars in 1024 bytes} [Sat Sep 24 19:21:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:21:41.094778 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c416cee-7177-4662-8a63-ad70f786cc2a None None] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:41.098597 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:41.117007 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874c4c47-e035-427a-a894-334217fd4b22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:41.118086 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874c4c47-e035-427a-a894-334217fd4b22 None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:41.118819 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874c4c47-e035-427a-a894-334217fd4b22 None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:41.120344 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874c4c47-e035-427a-a894-334217fd4b22 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:41.122172 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874c4c47-e035-427a-a894-334217fd4b22 None admin] RBAC: Adding query filter params (group.id=74fc04883e9540a58ba966142053d6ed, role.id=a24280fb630f4c17865458d833144b17, scope.project.id=b7aa834667ed445eba7561ef6fd2d3c6) {{(pid=88080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:21:41.123030 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874c4c47-e035-427a-a894-334217fd4b22 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:41.126940 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874c4c47-e035-427a-a894-334217fd4b22 None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:41.140867 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 218/434] 10.222.0.18 () {56 vars in 1376 bytes} [Sat Sep 24 19:21:40 2022] GET /identity/v3/role_assignments?group.id=74fc04883e9540a58ba966142053d6ed&scope.project.id=b7aa834667ed445eba7561ef6fd2d3c6&role.id=a24280fb630f4c17865458d833144b17 => generated 611 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:21:41.174415 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d6d792-0939-4141-bddc-1d7a1f60ce91 None None] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:41.175049 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d6d792-0939-4141-bddc-1d7a1f60ce91 None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:41.175552 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d6d792-0939-4141-bddc-1d7a1f60ce91 None None] PATH_INFO: `/` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:41.177170 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 219/435] 10.222.0.18 () {54 vars in 927 bytes} [Sat Sep 24 19:21:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:21:41.183377 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3747966f-e3c8-40a2-8d35-3d74d7877a61 None None] REQUEST_METHOD: `POST` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:41.184005 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3747966f-e3c8-40a2-8d35-3d74d7877a61 None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:41.184481 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3747966f-e3c8-40a2-8d35-3d74d7877a61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:41.223528 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.auth.core [None req-3747966f-e3c8-40a2-8d35-3d74d7877a61 None None] MFA Rules not processed for user `3dbbb9909cec43ff99c1c3682f016ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=88080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:21:41.224791 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.fernet_utils [None req-3747966f-e3c8-40a2-8d35-3d74d7877a61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:21:41.316795 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c416cee-7177-4662-8a63-ad70f786cc2a None None] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:41.377998 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51c34a8-f56c-401b-864a-7e45ecf9cec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:41.380351 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51c34a8-f56c-401b-864a-7e45ecf9cec2 None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:41.381555 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51c34a8-f56c-401b-864a-7e45ecf9cec2 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:41.382313 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51c34a8-f56c-401b-864a-7e45ecf9cec2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:41.384545 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51c34a8-f56c-401b-864a-7e45ecf9cec2 None admin] RBAC: Adding query filter params (group.id=74fc04883e9540a58ba966142053d6ed, role.id=3a42524fc57c4487a34c5c05234413a7, scope.project.id=b7aa834667ed445eba7561ef6fd2d3c6) {{(pid=88081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:21:41.386188 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51c34a8-f56c-401b-864a-7e45ecf9cec2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:41.387939 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51c34a8-f56c-401b-864a-7e45ecf9cec2 None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:41.395242 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 217/436] 10.222.0.18 () {56 vars in 1376 bytes} [Sat Sep 24 19:21:41 2022] GET /identity/v3/role_assignments?group.id=74fc04883e9540a58ba966142053d6ed&scope.project.id=b7aa834667ed445eba7561ef6fd2d3c6&role.id=3a42524fc57c4487a34c5c05234413a7 => generated 611 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:21:41.396377 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51c34a8-f56c-401b-864a-7e45ecf9cec2 None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:41.425693 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 220/437] 10.222.0.18 () {58 vars in 1024 bytes} [Sat Sep 24 19:21:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 24 19:21:41.436051 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:41.525572 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3747966f-e3c8-40a2-8d35-3d74d7877a61 None None] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:41.601116 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51c34a8-f56c-401b-864a-7e45ecf9cec2 None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:41.655364 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d18b1d4-497d-4019-a8ee-101bc0282791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:41.658055 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d18b1d4-497d-4019-a8ee-101bc0282791 None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:41.658055 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d18b1d4-497d-4019-a8ee-101bc0282791 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:41.658055 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d18b1d4-497d-4019-a8ee-101bc0282791 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:41.676110 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d18b1d4-497d-4019-a8ee-101bc0282791 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:21:41.685095 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application [None req-7d18b1d4-497d-4019-a8ee-101bc0282791 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 24 19:21:41.685095 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:21:41.685095 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:21:41.685095 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:21:41.685095 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:21:41.685095 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:21:41.685095 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:21:41.685095 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:21:41.685095 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:21:41.685095 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:21:41.685095 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:21:41.685095 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:21:41.685095 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:21:41.685095 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:21:41.685095 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:21:41.685095 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:21:41.686506 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:21:41.686506 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:21:41.686506 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:21:41.686506 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:21:41.686506 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:21:41.686506 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:21:41.686506 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:21:41.686506 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:21:41.686506 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:21:41.686506 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:21:41.686506 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:21:41.686506 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application with Lock( Sep 24 19:21:41.686506 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:21:41.686506 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:21:41.686506 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:21:41.686506 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:21:41.687288 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:21:41.687288 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:21:41.687288 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:21:41.687288 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:21:41.687288 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:21:41.687288 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:21:41.687288 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:21:41.687288 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:21:41.687288 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:21:41.687288 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:21:41.687288 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 24 19:21:41.687288 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Sep 24 19:21:41.687889 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3747966f-e3c8-40a2-8d35-3d74d7877a61 None None] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:41.687961 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 218/438] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Sep 24 19:21:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:21:41.696788 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d18b1d4-497d-4019-a8ee-101bc0282791 None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:41.717203 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:41.731083 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4d5f01-1c81-4fe0-8cdb-e693ef373726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:41.732587 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4d5f01-1c81-4fe0-8cdb-e693ef373726 None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:41.732863 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4d5f01-1c81-4fe0-8cdb-e693ef373726 None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:41.733130 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4d5f01-1c81-4fe0-8cdb-e693ef373726 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:41.750282 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4d5f01-1c81-4fe0-8cdb-e693ef373726 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:21:41.755544 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application [None req-3b4d5f01-1c81-4fe0-8cdb-e693ef373726 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 24 19:21:41.755544 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:21:41.755544 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:21:41.755544 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:21:41.755544 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:21:41.755544 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:21:41.755544 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:21:41.755544 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:21:41.755544 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:21:41.755544 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:21:41.755544 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:21:41.755544 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:21:41.755544 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:21:41.755544 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:21:41.755544 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:21:41.755544 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:21:41.756437 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:21:41.756437 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:21:41.756437 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:21:41.756437 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:21:41.756437 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:21:41.756437 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:21:41.756437 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:21:41.756437 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:21:41.756437 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:21:41.756437 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:21:41.756437 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:21:41.756437 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application with Lock( Sep 24 19:21:41.756437 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:21:41.756437 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:21:41.756437 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:21:41.756437 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:21:41.757228 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:21:41.757228 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:21:41.757228 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:21:41.757228 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:21:41.757228 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:21:41.757228 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:21:41.757228 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:21:41.757228 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:21:41.757228 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:21:41.757228 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:21:41.757228 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 24 19:21:41.757228 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Sep 24 19:21:41.757228 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 221/439] 10.222.0.18 () {56 vars in 1114 bytes} [Sat Sep 24 19:21:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 19:21:41.764021 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4d5f01-1c81-4fe0-8cdb-e693ef373726 None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:41.826335 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:41.849654 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d18b1d4-497d-4019-a8ee-101bc0282791 None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:41.894742 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5e193e-8e75-4bf1-8cfa-0f5870bb5997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:41.895277 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5e193e-8e75-4bf1-8cfa-0f5870bb5997 None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:41.895487 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4d5f01-1c81-4fe0-8cdb-e693ef373726 None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:41.895642 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5e193e-8e75-4bf1-8cfa-0f5870bb5997 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:41.895807 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5e193e-8e75-4bf1-8cfa-0f5870bb5997 None admin] PATH_INFO: `/v3/roles` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:41.896468 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5e193e-8e75-4bf1-8cfa-0f5870bb5997 None admin] RBAC: Adding query filter params (name=member) {{(pid=88081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:21:41.896763 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5e193e-8e75-4bf1-8cfa-0f5870bb5997 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:41.898176 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5e193e-8e75-4bf1-8cfa-0f5870bb5997 None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:41.911075 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 219/440] 10.222.0.18 () {56 vars in 1101 bytes} [Sat Sep 24 19:21:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:21:41.911075 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5e193e-8e75-4bf1-8cfa-0f5870bb5997 None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:41.939000 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d98958-16fe-495f-951b-8d503ddb1fb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:41.939602 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d98958-16fe-495f-951b-8d503ddb1fb0 None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:41.939877 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d98958-16fe-495f-951b-8d503ddb1fb0 None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:41.940206 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d98958-16fe-495f-951b-8d503ddb1fb0 None admin] PATH_INFO: `/v3/roles` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:41.940808 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d98958-16fe-495f-951b-8d503ddb1fb0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:21:41.941108 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d98958-16fe-495f-951b-8d503ddb1fb0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:41.942544 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d98958-16fe-495f-951b-8d503ddb1fb0 None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:41.951261 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 222/441] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Sep 24 19:21:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:21:41.951923 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d98958-16fe-495f-951b-8d503ddb1fb0 None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:42.008817 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:42.038065 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5e193e-8e75-4bf1-8cfa-0f5870bb5997 None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:42.066957 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d98958-16fe-495f-951b-8d503ddb1fb0 None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:42.085942 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7618e68-f2a0-4917-b3b4-1fd45c1b3de3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:42.086581 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7618e68-f2a0-4917-b3b4-1fd45c1b3de3 None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:42.086887 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7618e68-f2a0-4917-b3b4-1fd45c1b3de3 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:42.087176 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7618e68-f2a0-4917-b3b4-1fd45c1b3de3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:42.098008 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7618e68-f2a0-4917-b3b4-1fd45c1b3de3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:21:42.103231 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application [None req-a7618e68-f2a0-4917-b3b4-1fd45c1b3de3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 19:21:42.103231 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:21:42.103231 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:21:42.103231 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:21:42.103231 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:21:42.103231 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:21:42.103231 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:21:42.103231 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:21:42.103231 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:21:42.103231 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:21:42.103231 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:21:42.103231 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:21:42.103231 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:21:42.103231 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:21:42.103231 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:21:42.103231 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:21:42.104323 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:21:42.104323 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:21:42.104323 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:21:42.104323 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:21:42.104323 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:21:42.104323 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:21:42.104323 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:21:42.104323 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:21:42.104323 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:21:42.104323 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:21:42.104323 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:21:42.104323 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application with Lock( Sep 24 19:21:42.104323 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:21:42.104323 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:21:42.104323 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:21:42.104323 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:21:42.105302 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:21:42.105302 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:21:42.105302 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:21:42.105302 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:21:42.105302 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:21:42.105302 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:21:42.105302 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:21:42.105302 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:21:42.105302 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:21:42.105302 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:21:42.105302 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 19:21:42.105302 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Sep 24 19:21:42.105302 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 220/442] 10.222.0.18 () {56 vars in 1096 bytes} [Sat Sep 24 19:21:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:21:42.105302 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7618e68-f2a0-4917-b3b4-1fd45c1b3de3 None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:42.107749 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337d0ec0-48e6-4406-a067-f0dd7a86d69b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:42.108136 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:42.108489 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337d0ec0-48e6-4406-a067-f0dd7a86d69b None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:42.109111 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337d0ec0-48e6-4406-a067-f0dd7a86d69b None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:42.109111 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337d0ec0-48e6-4406-a067-f0dd7a86d69b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:42.178741 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337d0ec0-48e6-4406-a067-f0dd7a86d69b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:42.180254 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337d0ec0-48e6-4406-a067-f0dd7a86d69b None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:42.208619 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7618e68-f2a0-4917-b3b4-1fd45c1b3de3 None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:42.228188 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:42.244504 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabf45be-a36b-4cf2-8d1b-d90bc7e95452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:42.245136 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabf45be-a36b-4cf2-8d1b-d90bc7e95452 None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:42.245409 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabf45be-a36b-4cf2-8d1b-d90bc7e95452 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:42.245674 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabf45be-a36b-4cf2-8d1b-d90bc7e95452 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:42.282061 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 223/443] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Sep 24 19:21:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 24 19:21:42.282942 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337d0ec0-48e6-4406-a067-f0dd7a86d69b None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:42.315653 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabf45be-a36b-4cf2-8d1b-d90bc7e95452 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:42.317162 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabf45be-a36b-4cf2-8d1b-d90bc7e95452 None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:42.319178 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:42.385530 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337d0ec0-48e6-4406-a067-f0dd7a86d69b None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:42.421352 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cdbf13-55f4-432d-a67e-48926bea01b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:42.421984 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cdbf13-55f4-432d-a67e-48926bea01b0 None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:42.422260 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cdbf13-55f4-432d-a67e-48926bea01b0 None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:42.422528 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cdbf13-55f4-432d-a67e-48926bea01b0 None admin] PATH_INFO: `/v3/roles` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:42.423223 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cdbf13-55f4-432d-a67e-48926bea01b0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:21:42.423520 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cdbf13-55f4-432d-a67e-48926bea01b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:42.424909 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cdbf13-55f4-432d-a67e-48926bea01b0 None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:42.430953 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 221/444] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Sep 24 19:21:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 24 19:21:42.431633 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabf45be-a36b-4cf2-8d1b-d90bc7e95452 None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:42.440391 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 224/445] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Sep 24 19:21:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:21:42.442213 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cdbf13-55f4-432d-a67e-48926bea01b0 None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:42.456826 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:42.537306 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabf45be-a36b-4cf2-8d1b-d90bc7e95452 None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:42.538851 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:42.549171 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cdbf13-55f4-432d-a67e-48926bea01b0 None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:42.576538 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4deaf34-5b83-4588-80d7-362e1795d3e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:42.577197 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4deaf34-5b83-4588-80d7-362e1795d3e0 None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:42.577451 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4deaf34-5b83-4588-80d7-362e1795d3e0 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:42.577720 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4deaf34-5b83-4588-80d7-362e1795d3e0 None admin] PATH_INFO: `/v3/projects/b86798f4dc4d4dd79428558b3d00ae1a` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:42.578933 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4deaf34-5b83-4588-80d7-362e1795d3e0 None admin] RBAC: Authorizing `identity:get_project(project_id=b86798f4dc4d4dd79428558b3d00ae1a)` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:42.581027 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4deaf34-5b83-4588-80d7-362e1795d3e0 None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:42.582829 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 222/446] 10.222.0.18 () {56 vars in 1186 bytes} [Sat Sep 24 19:21:42 2022] GET /identity/v3/projects/b86798f4dc4d4dd79428558b3d00ae1a => generated 302 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:21:42.583693 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4deaf34-5b83-4588-80d7-362e1795d3e0 None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:42.587994 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d716b99b-a67c-4ae4-a7bb-4c48f5a7ba7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:42.588462 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d716b99b-a67c-4ae4-a7bb-4c48f5a7ba7f None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:42.588749 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d716b99b-a67c-4ae4-a7bb-4c48f5a7ba7f None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:42.589021 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d716b99b-a67c-4ae4-a7bb-4c48f5a7ba7f None admin] PATH_INFO: `/v3/projects/b86798f4dc4d4dd79428558b3d00ae1a` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:42.590201 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d716b99b-a67c-4ae4-a7bb-4c48f5a7ba7f None admin] RBAC: Authorizing `identity:get_project(project_id=b86798f4dc4d4dd79428558b3d00ae1a)` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:42.591617 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d716b99b-a67c-4ae4-a7bb-4c48f5a7ba7f None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:42.593458 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 225/447] 10.222.0.18 () {56 vars in 1186 bytes} [Sat Sep 24 19:21:42 2022] GET /identity/v3/projects/b86798f4dc4d4dd79428558b3d00ae1a => generated 302 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:21:42.594255 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d716b99b-a67c-4ae4-a7bb-4c48f5a7ba7f None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:42.676234 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:42.699072 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4deaf34-5b83-4588-80d7-362e1795d3e0 None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:42.702884 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d716b99b-a67c-4ae4-a7bb-4c48f5a7ba7f None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:42.734410 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5231878d-9805-4908-8429-2fb098213b7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:42.735046 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5231878d-9805-4908-8429-2fb098213b7d None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:42.735352 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5231878d-9805-4908-8429-2fb098213b7d None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:42.735624 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5231878d-9805-4908-8429-2fb098213b7d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:42.737353 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9fc1a6-9b4e-47e8-aba8-7f98cba4cb27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:42.737996 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9fc1a6-9b4e-47e8-aba8-7f98cba4cb27 None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:42.738273 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9fc1a6-9b4e-47e8-aba8-7f98cba4cb27 None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:42.738537 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9fc1a6-9b4e-47e8-aba8-7f98cba4cb27 None admin] PATH_INFO: `/v3/groups/74fc04883e9540a58ba966142053d6ed` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:42.739641 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9fc1a6-9b4e-47e8-aba8-7f98cba4cb27 None admin] RBAC: Authorizing `identity:get_group(group_id=74fc04883e9540a58ba966142053d6ed)` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:42.741346 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9fc1a6-9b4e-47e8-aba8-7f98cba4cb27 None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:42.742929 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 226/448] 10.222.0.18 () {56 vars in 1180 bytes} [Sat Sep 24 19:21:42 2022] GET /identity/v3/groups/74fc04883e9540a58ba966142053d6ed => generated 226 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:21:42.743766 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9fc1a6-9b4e-47e8-aba8-7f98cba4cb27 None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:42.779450 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:42.810349 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5231878d-9805-4908-8429-2fb098213b7d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:42.811822 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5231878d-9805-4908-8429-2fb098213b7d None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:42.849291 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9fc1a6-9b4e-47e8-aba8-7f98cba4cb27 None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:42.882641 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16369a3-1110-489a-bbf4-635b2c2684c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:42.883259 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16369a3-1110-489a-bbf4-635b2c2684c8 None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:42.883535 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16369a3-1110-489a-bbf4-635b2c2684c8 None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:42.883805 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16369a3-1110-489a-bbf4-635b2c2684c8 None admin] PATH_INFO: `/v3/groups/74fc04883e9540a58ba966142053d6ed` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:42.884904 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16369a3-1110-489a-bbf4-635b2c2684c8 None admin] RBAC: Authorizing `identity:get_group(group_id=74fc04883e9540a58ba966142053d6ed)` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:42.886371 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16369a3-1110-489a-bbf4-635b2c2684c8 None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:42.887964 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 227/449] 10.222.0.18 () {56 vars in 1180 bytes} [Sat Sep 24 19:21:42 2022] GET /identity/v3/groups/74fc04883e9540a58ba966142053d6ed => generated 226 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:21:42.888721 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16369a3-1110-489a-bbf4-635b2c2684c8 None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:42.903485 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:42.913398 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 223/450] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Sep 24 19:21:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 24 19:21:42.914288 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5231878d-9805-4908-8429-2fb098213b7d None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:42.985036 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:42.991183 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16369a3-1110-489a-bbf4-635b2c2684c8 None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:43.023700 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5231878d-9805-4908-8429-2fb098213b7d None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:43.030441 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ec2eed-41ce-4797-aaf4-617b108aace4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:43.031041 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ec2eed-41ce-4797-aaf4-617b108aace4 None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:43.031326 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ec2eed-41ce-4797-aaf4-617b108aace4 None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:43.031597 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ec2eed-41ce-4797-aaf4-617b108aace4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:43.032843 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ec2eed-41ce-4797-aaf4-617b108aace4 None admin] RBAC: Adding query filter params (group.id=74fc04883e9540a58ba966142053d6ed, role.id=3a42524fc57c4487a34c5c05234413a7, scope.project.id=b86798f4dc4d4dd79428558b3d00ae1a) {{(pid=88080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:21:43.033148 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ec2eed-41ce-4797-aaf4-617b108aace4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:43.034621 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ec2eed-41ce-4797-aaf4-617b108aace4 None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:43.040591 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 228/451] 10.222.0.18 () {56 vars in 1376 bytes} [Sat Sep 24 19:21:42 2022] GET /identity/v3/role_assignments?group.id=74fc04883e9540a58ba966142053d6ed&scope.project.id=b86798f4dc4d4dd79428558b3d00ae1a&role.id=3a42524fc57c4487a34c5c05234413a7 => generated 611 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:21:43.041382 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ec2eed-41ce-4797-aaf4-617b108aace4 None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:43.075137 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c68e091-6b7e-40da-8cd5-0b3ff42a00ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:43.076093 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c68e091-6b7e-40da-8cd5-0b3ff42a00ed None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:43.076525 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c68e091-6b7e-40da-8cd5-0b3ff42a00ed None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:43.076797 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c68e091-6b7e-40da-8cd5-0b3ff42a00ed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:43.077555 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c68e091-6b7e-40da-8cd5-0b3ff42a00ed None admin] RBAC: Adding query filter params (group.id=74fc04883e9540a58ba966142053d6ed, role.id=a24280fb630f4c17865458d833144b17, scope.project.id=b86798f4dc4d4dd79428558b3d00ae1a) {{(pid=88081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:21:43.077904 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c68e091-6b7e-40da-8cd5-0b3ff42a00ed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:43.079459 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c68e091-6b7e-40da-8cd5-0b3ff42a00ed None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:43.097873 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 224/452] 10.222.0.18 () {56 vars in 1376 bytes} [Sat Sep 24 19:21:42 2022] GET /identity/v3/role_assignments?group.id=74fc04883e9540a58ba966142053d6ed&scope.project.id=b86798f4dc4d4dd79428558b3d00ae1a&role.id=a24280fb630f4c17865458d833144b17 => generated 611 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:21:43.154926 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:43.185190 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ec2eed-41ce-4797-aaf4-617b108aace4 None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:43.225652 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a19b9dc-f2d5-4d27-be42-1f28ddcd6354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:43.226396 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a19b9dc-f2d5-4d27-be42-1f28ddcd6354 None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:43.226696 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a19b9dc-f2d5-4d27-be42-1f28ddcd6354 None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:43.226971 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a19b9dc-f2d5-4d27-be42-1f28ddcd6354 None admin] PATH_INFO: `/v3/projects/9fc67bd325c24a418945f738b4bd5c71` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:43.228235 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a19b9dc-f2d5-4d27-be42-1f28ddcd6354 None admin] RBAC: Authorizing `identity:get_project(project_id=9fc67bd325c24a418945f738b4bd5c71)` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:43.229733 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a19b9dc-f2d5-4d27-be42-1f28ddcd6354 None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:43.231505 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 229/453] 10.222.0.18 () {56 vars in 1186 bytes} [Sat Sep 24 19:21:43 2022] GET /identity/v3/projects/9fc67bd325c24a418945f738b4bd5c71 => generated 344 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:21:43.238286 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c68e091-6b7e-40da-8cd5-0b3ff42a00ed None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:43.360807 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c68e091-6b7e-40da-8cd5-0b3ff42a00ed None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:43.399846 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4b30c6-8c89-4306-832f-d5bd2782afe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:43.400480 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4b30c6-8c89-4306-832f-d5bd2782afe3 None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:43.400760 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4b30c6-8c89-4306-832f-d5bd2782afe3 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:43.401031 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4b30c6-8c89-4306-832f-d5bd2782afe3 None admin] PATH_INFO: `/v3/groups/749e2f9df4bd44c2acd0bea537441561` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:43.402160 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4b30c6-8c89-4306-832f-d5bd2782afe3 None admin] RBAC: Authorizing `identity:get_group(group_id=749e2f9df4bd44c2acd0bea537441561)` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:43.403598 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4b30c6-8c89-4306-832f-d5bd2782afe3 None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:43.405157 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 225/454] 10.222.0.18 () {56 vars in 1180 bytes} [Sat Sep 24 19:21:43 2022] GET /identity/v3/groups/749e2f9df4bd44c2acd0bea537441561 => generated 229 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:21:43.411091 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a19b9dc-f2d5-4d27-be42-1f28ddcd6354 None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:43.523705 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a19b9dc-f2d5-4d27-be42-1f28ddcd6354 None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:43.563245 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513466ce-a435-4a28-a41f-984dc73668a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:43.564520 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513466ce-a435-4a28-a41f-984dc73668a2 None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:43.564757 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513466ce-a435-4a28-a41f-984dc73668a2 None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:43.565028 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513466ce-a435-4a28-a41f-984dc73668a2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:43.565764 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513466ce-a435-4a28-a41f-984dc73668a2 None admin] RBAC: Adding query filter params (group.id=749e2f9df4bd44c2acd0bea537441561, role.id=4c7d0dafc19b4b0a9821be6ec0da0a8f, scope.project.id=9fc67bd325c24a418945f738b4bd5c71) {{(pid=88080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:21:43.566149 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513466ce-a435-4a28-a41f-984dc73668a2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:43.567548 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513466ce-a435-4a28-a41f-984dc73668a2 None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:43.573961 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 230/455] 10.222.0.18 () {56 vars in 1376 bytes} [Sat Sep 24 19:21:43 2022] GET /identity/v3/role_assignments?group.id=749e2f9df4bd44c2acd0bea537441561&scope.project.id=9fc67bd325c24a418945f738b4bd5c71&role.id=4c7d0dafc19b4b0a9821be6ec0da0a8f => generated 611 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:21:46.434112 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fcaf03-acaf-48af-af29-b73b2d8693a5 None None] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:46.434661 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fcaf03-acaf-48af-af29-b73b2d8693a5 None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:46.434741 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fcaf03-acaf-48af-af29-b73b2d8693a5 None None] PATH_INFO: `/` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:46.436399 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 226/456] 10.222.0.18 () {54 vars in 927 bytes} [Sat Sep 24 19:21:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:21:46.442519 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e703187d-ea4e-490a-8ee6-f35debd6c8c7 None None] REQUEST_METHOD: `POST` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:46.443453 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e703187d-ea4e-490a-8ee6-f35debd6c8c7 None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:46.443951 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e703187d-ea4e-490a-8ee6-f35debd6c8c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:46.465439 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.auth.core [None req-e703187d-ea4e-490a-8ee6-f35debd6c8c7 None None] MFA Rules not processed for user `3dbbb9909cec43ff99c1c3682f016ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=88080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:21:46.466962 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.fernet_utils [None req-e703187d-ea4e-490a-8ee6-f35debd6c8c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:21:46.469173 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:46.484440 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20646b1d-7165-436e-aa47-a91402061f79 None None] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:46.485123 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20646b1d-7165-436e-aa47-a91402061f79 None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:46.485687 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20646b1d-7165-436e-aa47-a91402061f79 None None] PATH_INFO: `/` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:46.487507 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 227/457] 10.222.0.18 () {54 vars in 927 bytes} [Sat Sep 24 19:21:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:21:46.492863 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11105af0-b3b9-453e-aa52-379f07ce4905 None None] REQUEST_METHOD: `POST` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:46.493496 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11105af0-b3b9-453e-aa52-379f07ce4905 None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:46.494140 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11105af0-b3b9-453e-aa52-379f07ce4905 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:46.501862 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:46.517564 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.auth.core [None req-11105af0-b3b9-453e-aa52-379f07ce4905 None None] MFA Rules not processed for user `3dbbb9909cec43ff99c1c3682f016ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=88081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:21:46.519216 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.fernet_utils [None req-11105af0-b3b9-453e-aa52-379f07ce4905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:21:46.542862 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 231/458] 10.222.0.18 () {58 vars in 1024 bytes} [Sat Sep 24 19:21:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:21:46.604059 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 228/459] 10.222.0.18 () {58 vars in 1024 bytes} [Sat Sep 24 19:21:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 24 19:21:46.704588 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97262fc-dfe7-4129-8676-6e006c03193d None None] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:46.704784 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97262fc-dfe7-4129-8676-6e006c03193d None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:46.705038 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97262fc-dfe7-4129-8676-6e006c03193d None None] PATH_INFO: `/` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:46.706606 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 232/460] 10.222.0.18 () {54 vars in 927 bytes} [Sat Sep 24 19:21:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:21:46.711894 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9a576d-4fe4-4d26-9a17-9fa77a7d4db7 None None] REQUEST_METHOD: `POST` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:46.712175 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9a576d-4fe4-4d26-9a17-9fa77a7d4db7 None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:46.712669 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9a576d-4fe4-4d26-9a17-9fa77a7d4db7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:46.730932 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.auth.core [None req-1b9a576d-4fe4-4d26-9a17-9fa77a7d4db7 None None] MFA Rules not processed for user `3dbbb9909cec43ff99c1c3682f016ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=88081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:21:46.732529 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.fernet_utils [None req-1b9a576d-4fe4-4d26-9a17-9fa77a7d4db7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:21:46.803679 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 229/461] 10.222.0.18 () {58 vars in 1024 bytes} [Sat Sep 24 19:21:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:21:46.891229 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97262fc-dfe7-4129-8676-6e006c03193d None None] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:46.948902 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9a576d-4fe4-4d26-9a17-9fa77a7d4db7 None None] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:47.014993 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:47.016608 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97262fc-dfe7-4129-8676-6e006c03193d None None] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:47.062190 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f23189-52e8-4466-9db9-3566dcaf5c38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:47.062437 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9a576d-4fe4-4d26-9a17-9fa77a7d4db7 None None] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:47.062821 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f23189-52e8-4466-9db9-3566dcaf5c38 None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:47.063672 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f23189-52e8-4466-9db9-3566dcaf5c38 None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:47.063954 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f23189-52e8-4466-9db9-3566dcaf5c38 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:47.073108 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:47.078272 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f23189-52e8-4466-9db9-3566dcaf5c38 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:47.080627 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f23189-52e8-4466-9db9-3566dcaf5c38 None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:47.099465 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application [None req-a6f23189-52e8-4466-9db9-3566dcaf5c38 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:21:47.099465 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:21:47.099465 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:21:47.099465 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:21:47.099465 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:21:47.099465 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:21:47.099465 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:21:47.099465 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:21:47.099465 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:21:47.099465 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:21:47.099465 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:21:47.099465 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:21:47.099465 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:21:47.099465 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:21:47.099465 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:21:47.099465 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:21:47.100433 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:21:47.100433 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:21:47.100433 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:21:47.100433 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:21:47.100433 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:21:47.100433 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:21:47.100433 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:21:47.100433 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application with Lock( Sep 24 19:21:47.100433 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:21:47.100433 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:21:47.100433 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:21:47.100433 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:21:47.100433 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:21:47.100433 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:21:47.100433 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:21:47.100433 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:21:47.100433 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:21:47.101291 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:21:47.101291 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:21:47.101291 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Sep 24 19:21:47.101291 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 233/462] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Sep 24 19:21:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:21:47.101719 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe7c940-73b6-401b-9e64-912c8b030dc4 None None] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:47.102168 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe7c940-73b6-401b-9e64-912c8b030dc4 None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:47.102434 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe7c940-73b6-401b-9e64-912c8b030dc4 None None] PATH_INFO: `/` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:47.103795 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 234/463] 10.222.0.18 () {54 vars in 927 bytes} [Sat Sep 24 19:21:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:21:47.108609 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe7c940-73b6-401b-9e64-912c8b030dc4 None None] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:47.109122 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea1fee8-6b19-4d79-96d1-562de781920b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:47.109770 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea1fee8-6b19-4d79-96d1-562de781920b None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:47.110576 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea1fee8-6b19-4d79-96d1-562de781920b None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:47.110844 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea1fee8-6b19-4d79-96d1-562de781920b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:47.125421 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea1fee8-6b19-4d79-96d1-562de781920b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:47.127595 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea1fee8-6b19-4d79-96d1-562de781920b None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:47.144060 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application [None req-2ea1fee8-6b19-4d79-96d1-562de781920b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:21:47.144060 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:21:47.144060 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:21:47.144060 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:21:47.144060 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:21:47.144060 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:21:47.144060 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:21:47.144060 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:21:47.144060 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:21:47.144060 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:21:47.144060 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:21:47.144060 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:21:47.144060 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:21:47.144060 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:21:47.144060 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:21:47.144060 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:21:47.145340 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:21:47.145340 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:21:47.145340 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:21:47.145340 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:21:47.145340 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:21:47.145340 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:21:47.145340 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:21:47.145340 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application with Lock( Sep 24 19:21:47.145340 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:21:47.145340 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:21:47.145340 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:21:47.145340 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:21:47.145340 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:21:47.145340 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:21:47.145340 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:21:47.145340 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:21:47.145340 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:21:47.146490 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:21:47.146490 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:21:47.146490 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Sep 24 19:21:47.146490 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 230/464] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Sep 24 19:21:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:21:47.146490 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7741f9b9-5a83-4245-967d-bca1bea0923e None None] REQUEST_METHOD: `POST` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:47.146490 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7741f9b9-5a83-4245-967d-bca1bea0923e None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:47.146490 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7741f9b9-5a83-4245-967d-bca1bea0923e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:47.164887 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.auth.core [None req-7741f9b9-5a83-4245-967d-bca1bea0923e None None] MFA Rules not processed for user `3dbbb9909cec43ff99c1c3682f016ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=88081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:21:47.166132 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.fernet_utils [None req-7741f9b9-5a83-4245-967d-bca1bea0923e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:21:47.238351 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe7c940-73b6-401b-9e64-912c8b030dc4 None None] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:47.239115 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 231/465] 10.222.0.18 () {58 vars in 1024 bytes} [Sat Sep 24 19:21:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:21:47.240146 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7741f9b9-5a83-4245-967d-bca1bea0923e None None] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:47.284921 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d43ad8-4337-4aef-808f-c449ca273c7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:47.285439 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d43ad8-4337-4aef-808f-c449ca273c7f None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:47.285717 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d43ad8-4337-4aef-808f-c449ca273c7f None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:47.286014 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d43ad8-4337-4aef-808f-c449ca273c7f None admin] PATH_INFO: `/v3/domains` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:47.286728 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d43ad8-4337-4aef-808f-c449ca273c7f None admin] RBAC: Adding query filter params (name=Default) {{(pid=88080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:21:47.287029 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d43ad8-4337-4aef-808f-c449ca273c7f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:47.288952 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d43ad8-4337-4aef-808f-c449ca273c7f None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:47.294670 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:47.304706 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 235/466] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Sep 24 19:21:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:21:47.305783 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d43ad8-4337-4aef-808f-c449ca273c7f None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:47.382026 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:47.386436 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7741f9b9-5a83-4245-967d-bca1bea0923e None None] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:47.434994 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fb0873-91bd-4f7d-9714-9bdb033cb263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:47.437069 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fb0873-91bd-4f7d-9714-9bdb033cb263 None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:47.437483 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fb0873-91bd-4f7d-9714-9bdb033cb263 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:47.438013 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fb0873-91bd-4f7d-9714-9bdb033cb263 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:47.449663 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d43ad8-4337-4aef-808f-c449ca273c7f None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:47.471792 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fb0873-91bd-4f7d-9714-9bdb033cb263 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:47.474875 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fb0873-91bd-4f7d-9714-9bdb033cb263 None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:47.496284 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application [None req-84fb0873-91bd-4f7d-9714-9bdb033cb263 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:21:47.496284 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:21:47.496284 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:21:47.496284 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:21:47.496284 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:21:47.496284 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:21:47.496284 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:21:47.496284 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:21:47.496284 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:21:47.496284 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:21:47.496284 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:21:47.496284 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:21:47.496284 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:21:47.496284 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:21:47.496284 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:21:47.496284 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:21:47.497540 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:21:47.497540 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:21:47.497540 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:21:47.497540 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:21:47.497540 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:21:47.497540 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:21:47.497540 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:21:47.497540 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application with Lock( Sep 24 19:21:47.497540 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:21:47.497540 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:21:47.497540 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:21:47.497540 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:21:47.497540 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:21:47.497540 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:21:47.497540 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:21:47.497540 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:21:47.497540 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:21:47.498626 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:21:47.498626 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:21:47.498626 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Sep 24 19:21:47.500786 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 232/467] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Sep 24 19:21:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:21:47.502079 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fb0873-91bd-4f7d-9714-9bdb033cb263 None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:47.507595 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3727466c-dfeb-4b14-9f2c-ba566d1b3458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:47.508282 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3727466c-dfeb-4b14-9f2c-ba566d1b3458 None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:47.508912 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3727466c-dfeb-4b14-9f2c-ba566d1b3458 None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:47.509199 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3727466c-dfeb-4b14-9f2c-ba566d1b3458 None admin] PATH_INFO: `/v3/domains` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:47.509944 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3727466c-dfeb-4b14-9f2c-ba566d1b3458 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:21:47.510247 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3727466c-dfeb-4b14-9f2c-ba566d1b3458 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:47.512778 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3727466c-dfeb-4b14-9f2c-ba566d1b3458 None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:47.543508 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 236/468] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Sep 24 19:21:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:21:47.543508 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3727466c-dfeb-4b14-9f2c-ba566d1b3458 None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:47.659577 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:47.667294 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fb0873-91bd-4f7d-9714-9bdb033cb263 None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:47.691363 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3727466c-dfeb-4b14-9f2c-ba566d1b3458 None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:47.712533 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:47.723087 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2f3360-936c-4b96-9dcd-4f5577449d61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:47.723698 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2f3360-936c-4b96-9dcd-4f5577449d61 None admin] REQUEST_METHOD: `POST` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:47.723973 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2f3360-936c-4b96-9dcd-4f5577449d61 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:47.724238 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2f3360-936c-4b96-9dcd-4f5577449d61 None admin] PATH_INFO: `/v3/users` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:47.724885 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2f3360-936c-4b96-9dcd-4f5577449d61 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:47.726361 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2f3360-936c-4b96-9dcd-4f5577449d61 None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:47.740192 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae077b7-e3f2-477a-90fd-1cb3f0a04302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:47.741049 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae077b7-e3f2-477a-90fd-1cb3f0a04302 None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:47.741423 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae077b7-e3f2-477a-90fd-1cb3f0a04302 None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:47.741594 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae077b7-e3f2-477a-90fd-1cb3f0a04302 None admin] PATH_INFO: `/v3/domains` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:47.742320 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae077b7-e3f2-477a-90fd-1cb3f0a04302 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:21:47.742584 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae077b7-e3f2-477a-90fd-1cb3f0a04302 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:47.743987 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae077b7-e3f2-477a-90fd-1cb3f0a04302 None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:47.751012 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 233/469] 10.222.0.18 () {60 vars in 1132 bytes} [Sat Sep 24 19:21:47 2022] POST /identity/v3/users => generated 246 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:21:47.752153 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2f3360-936c-4b96-9dcd-4f5577449d61 None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:47.757070 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 237/470] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Sep 24 19:21:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:21:47.762570 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae077b7-e3f2-477a-90fd-1cb3f0a04302 None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:47.938566 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2f3360-936c-4b96-9dcd-4f5577449d61 None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:47.939633 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae077b7-e3f2-477a-90fd-1cb3f0a04302 None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:48.000055 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003aecd8-09e4-45a8-8b51-f5043ca41056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:48.000777 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003aecd8-09e4-45a8-8b51-f5043ca41056 None admin] REQUEST_METHOD: `POST` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:48.001088 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003aecd8-09e4-45a8-8b51-f5043ca41056 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:48.001387 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003aecd8-09e4-45a8-8b51-f5043ca41056 None admin] PATH_INFO: `/v3/users` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:48.002200 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003aecd8-09e4-45a8-8b51-f5043ca41056 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:48.003654 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003aecd8-09e4-45a8-8b51-f5043ca41056 None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:48.004008 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfabf20-199d-441a-ac8e-d2feb6455b71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:48.008530 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfabf20-199d-441a-ac8e-d2feb6455b71 None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:48.008530 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfabf20-199d-441a-ac8e-d2feb6455b71 None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:48.008530 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfabf20-199d-441a-ac8e-d2feb6455b71 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:48.020532 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfabf20-199d-441a-ac8e-d2feb6455b71 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:48.022536 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfabf20-199d-441a-ac8e-d2feb6455b71 None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:48.033591 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 234/471] 10.222.0.18 () {60 vars in 1132 bytes} [Sat Sep 24 19:21:47 2022] POST /identity/v3/users => generated 248 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:21:48.039760 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003aecd8-09e4-45a8-8b51-f5043ca41056 None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:48.049801 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application [None req-abfabf20-199d-441a-ac8e-d2feb6455b71 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:21:48.049801 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:21:48.049801 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:21:48.049801 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:21:48.049801 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:21:48.049801 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:21:48.049801 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:21:48.049801 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:21:48.049801 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:21:48.049801 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:21:48.049801 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:21:48.049801 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:21:48.049801 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:21:48.049801 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:21:48.049801 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:21:48.049801 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:21:48.051512 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:21:48.051512 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:21:48.051512 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:21:48.051512 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:21:48.051512 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:21:48.051512 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:21:48.051512 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:21:48.051512 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application with Lock( Sep 24 19:21:48.051512 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:21:48.051512 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:21:48.051512 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:21:48.051512 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:21:48.051512 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:21:48.051512 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:21:48.051512 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:21:48.051512 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:21:48.051512 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:21:48.054115 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:21:48.054115 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:21:48.054115 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Sep 24 19:21:48.054115 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 238/472] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Sep 24 19:21:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:21:48.061988 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:48.068962 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfabf20-199d-441a-ac8e-d2feb6455b71 None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:48.123172 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:48.243110 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003aecd8-09e4-45a8-8b51-f5043ca41056 None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:48.253806 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfabf20-199d-441a-ac8e-d2feb6455b71 None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:48.297559 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b4d0bf-aabe-4619-bd57-2e63095d7c3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:48.298369 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b4d0bf-aabe-4619-bd57-2e63095d7c3f None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:48.298680 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b4d0bf-aabe-4619-bd57-2e63095d7c3f None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:48.298987 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b4d0bf-aabe-4619-bd57-2e63095d7c3f None admin] PATH_INFO: `/v3/domains` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:48.299832 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b4d0bf-aabe-4619-bd57-2e63095d7c3f None admin] RBAC: Adding query filter params (name=Default) {{(pid=88080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:21:48.300157 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b4d0bf-aabe-4619-bd57-2e63095d7c3f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:48.301629 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b4d0bf-aabe-4619-bd57-2e63095d7c3f None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:48.309001 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9067d2a-c38a-465e-a261-cdcd33c51de6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:48.309630 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9067d2a-c38a-465e-a261-cdcd33c51de6 None admin] REQUEST_METHOD: `POST` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:48.311382 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9067d2a-c38a-465e-a261-cdcd33c51de6 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:48.311382 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9067d2a-c38a-465e-a261-cdcd33c51de6 None admin] PATH_INFO: `/v3/users` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:48.311382 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9067d2a-c38a-465e-a261-cdcd33c51de6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:48.312295 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9067d2a-c38a-465e-a261-cdcd33c51de6 None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:48.327782 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 239/473] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Sep 24 19:21:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:21:48.335323 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b4d0bf-aabe-4619-bd57-2e63095d7c3f None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:48.343315 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 235/474] 10.222.0.18 () {60 vars in 1132 bytes} [Sat Sep 24 19:21:48 2022] POST /identity/v3/users => generated 248 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:21:48.473057 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:48.514002 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b4d0bf-aabe-4619-bd57-2e63095d7c3f None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:48.585195 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9ef2f7-63e2-41bb-8d16-4cc07efb3f8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:48.586973 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9ef2f7-63e2-41bb-8d16-4cc07efb3f8e None admin] REQUEST_METHOD: `POST` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:48.587745 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9ef2f7-63e2-41bb-8d16-4cc07efb3f8e None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:48.588492 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9ef2f7-63e2-41bb-8d16-4cc07efb3f8e None admin] PATH_INFO: `/v3/users` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:48.590002 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9ef2f7-63e2-41bb-8d16-4cc07efb3f8e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:48.593067 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9ef2f7-63e2-41bb-8d16-4cc07efb3f8e None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:48.631816 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 240/475] 10.222.0.18 () {60 vars in 1132 bytes} [Sat Sep 24 19:21:48 2022] POST /identity/v3/users => generated 249 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:21:51.053816 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fb2356-5525-4eb0-a499-14a94452c12e None None] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:51.054550 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fb2356-5525-4eb0-a499-14a94452c12e None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:51.054550 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fb2356-5525-4eb0-a499-14a94452c12e None None] PATH_INFO: `/` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:51.055893 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 236/476] 10.222.0.18 () {54 vars in 927 bytes} [Sat Sep 24 19:21:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 24 19:21:51.061540 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8215a9fb-8b90-49ed-ba4e-d5328c0f2fd5 None None] REQUEST_METHOD: `POST` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:51.062302 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8215a9fb-8b90-49ed-ba4e-d5328c0f2fd5 None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:51.062302 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8215a9fb-8b90-49ed-ba4e-d5328c0f2fd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:51.083408 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.auth.core [None req-8215a9fb-8b90-49ed-ba4e-d5328c0f2fd5 None None] MFA Rules not processed for user `3dbbb9909cec43ff99c1c3682f016ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=88080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:21:51.084654 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.fernet_utils [None req-8215a9fb-8b90-49ed-ba4e-d5328c0f2fd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:21:51.179481 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 241/477] 10.222.0.18 () {58 vars in 1024 bytes} [Sat Sep 24 19:21:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:21:51.477291 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03436bba-1a22-407e-9989-4b86e57090cd None None] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:51.477725 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03436bba-1a22-407e-9989-4b86e57090cd None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:51.477856 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03436bba-1a22-407e-9989-4b86e57090cd None None] PATH_INFO: `/` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:51.479389 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 237/478] 10.222.0.18 () {54 vars in 927 bytes} [Sat Sep 24 19:21:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:21:51.485779 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71b21fd-0ed3-4e76-8b02-7c7366bbc492 None None] REQUEST_METHOD: `POST` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:51.486418 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71b21fd-0ed3-4e76-8b02-7c7366bbc492 None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:51.486895 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71b21fd-0ed3-4e76-8b02-7c7366bbc492 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:51.513111 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.auth.core [None req-c71b21fd-0ed3-4e76-8b02-7c7366bbc492 None None] MFA Rules not processed for user `3dbbb9909cec43ff99c1c3682f016ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=88080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:21:51.514720 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.fernet_utils [None req-c71b21fd-0ed3-4e76-8b02-7c7366bbc492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:21:51.537033 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03436bba-1a22-407e-9989-4b86e57090cd None None] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:51.591606 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:51.598367 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 242/479] 10.222.0.18 () {58 vars in 1024 bytes} [Sat Sep 24 19:21:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:21:51.610202 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:51.658663 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03436bba-1a22-407e-9989-4b86e57090cd None None] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:51.702208 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75980c3-4963-426e-a820-3dc300fa02a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:51.702857 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75980c3-4963-426e-a820-3dc300fa02a8 None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:51.703140 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75980c3-4963-426e-a820-3dc300fa02a8 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:51.703966 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75980c3-4963-426e-a820-3dc300fa02a8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:51.716923 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75980c3-4963-426e-a820-3dc300fa02a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:21:51.723156 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application [None req-e75980c3-4963-426e-a820-3dc300fa02a8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 24 19:21:51.723156 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:21:51.723156 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:21:51.723156 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:21:51.723156 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:21:51.723156 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:21:51.723156 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:21:51.723156 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:21:51.723156 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:21:51.723156 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:21:51.723156 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:21:51.723156 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:21:51.723156 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:21:51.723156 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:21:51.723156 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:21:51.723156 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:21:51.724133 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:21:51.724133 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:21:51.724133 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:21:51.724133 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:21:51.724133 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:21:51.724133 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:21:51.724133 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:21:51.724133 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:21:51.724133 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:21:51.724133 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:21:51.724133 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:21:51.724133 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application with Lock( Sep 24 19:21:51.724133 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:21:51.724133 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:21:51.724133 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:21:51.724133 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:21:51.724991 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:21:51.724991 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:21:51.724991 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:21:51.724991 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:21:51.724991 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:21:51.724991 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:21:51.724991 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:21:51.724991 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:21:51.724991 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:21:51.724991 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:21:51.724991 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 24 19:21:51.724991 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Sep 24 19:21:51.729513 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 238/480] 10.222.0.18 () {56 vars in 1102 bytes} [Sat Sep 24 19:21:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 19:21:51.730977 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71b21fd-0ed3-4e76-8b02-7c7366bbc492 None None] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:51.782755 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d29f1de-23af-46d0-9073-61468f755917 None None] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:51.783208 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d29f1de-23af-46d0-9073-61468f755917 None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:51.783671 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d29f1de-23af-46d0-9073-61468f755917 None None] PATH_INFO: `/` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:51.785172 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 239/481] 10.222.0.18 () {54 vars in 927 bytes} [Sat Sep 24 19:21:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 24 19:21:51.791619 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027048fe-ab8d-43ac-8342-a41d4b2c63ce None None] REQUEST_METHOD: `POST` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:51.792634 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027048fe-ab8d-43ac-8342-a41d4b2c63ce None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:51.793243 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027048fe-ab8d-43ac-8342-a41d4b2c63ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:51.823415 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.auth.core [None req-027048fe-ab8d-43ac-8342-a41d4b2c63ce None None] MFA Rules not processed for user `3dbbb9909cec43ff99c1c3682f016ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=88081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:21:51.825546 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.fernet_utils [None req-027048fe-ab8d-43ac-8342-a41d4b2c63ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:21:51.905025 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71b21fd-0ed3-4e76-8b02-7c7366bbc492 None None] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:51.961156 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3885e9da-43d1-4431-b689-430e91404e8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:51.961791 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3885e9da-43d1-4431-b689-430e91404e8c None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:51.962179 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3885e9da-43d1-4431-b689-430e91404e8c None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:51.962466 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3885e9da-43d1-4431-b689-430e91404e8c None admin] PATH_INFO: `/v3/roles` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:51.963147 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3885e9da-43d1-4431-b689-430e91404e8c None admin] RBAC: Adding query filter params (name=service) {{(pid=88080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:21:51.963411 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3885e9da-43d1-4431-b689-430e91404e8c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:51.964828 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3885e9da-43d1-4431-b689-430e91404e8c None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:51.967205 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 240/482] 10.222.0.18 () {58 vars in 1024 bytes} [Sat Sep 24 19:21:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:21:51.969252 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef85ee18-2882-4615-9159-d4e8b58622f4 None None] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:51.969745 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef85ee18-2882-4615-9159-d4e8b58622f4 None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:51.970259 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef85ee18-2882-4615-9159-d4e8b58622f4 None None] PATH_INFO: `/` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:51.972729 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 241/483] 10.222.0.18 () {54 vars in 927 bytes} [Sat Sep 24 19:21:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:21:51.982654 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 243/484] 10.222.0.18 () {56 vars in 1103 bytes} [Sat Sep 24 19:21:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:21:51.988437 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac21a63-6a85-475a-a698-145af505de6a None None] REQUEST_METHOD: `POST` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:51.988437 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac21a63-6a85-475a-a698-145af505de6a None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:51.988437 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac21a63-6a85-475a-a698-145af505de6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:51.990311 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3885e9da-43d1-4431-b689-430e91404e8c None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:52.015179 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.auth.core [None req-7ac21a63-6a85-475a-a698-145af505de6a None None] MFA Rules not processed for user `3dbbb9909cec43ff99c1c3682f016ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=88081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:21:52.017673 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.fernet_utils [None req-7ac21a63-6a85-475a-a698-145af505de6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:21:52.073976 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:52.100580 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:52.131284 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 242/485] 10.222.0.18 () {58 vars in 1024 bytes} [Sat Sep 24 19:21:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 24 19:21:52.132591 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac21a63-6a85-475a-a698-145af505de6a None None] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:52.162137 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3885e9da-43d1-4431-b689-430e91404e8c None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:52.231929 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb630c3-2ae2-44b3-aa11-a7cba9a6cc9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:52.233975 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb630c3-2ae2-44b3-aa11-a7cba9a6cc9a None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:52.234904 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb630c3-2ae2-44b3-aa11-a7cba9a6cc9a None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:52.235510 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb630c3-2ae2-44b3-aa11-a7cba9a6cc9a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:52.256046 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb630c3-2ae2-44b3-aa11-a7cba9a6cc9a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:52.258710 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb630c3-2ae2-44b3-aa11-a7cba9a6cc9a None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:52.285750 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application [None req-adb630c3-2ae2-44b3-aa11-a7cba9a6cc9a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:21:52.285750 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:21:52.285750 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:21:52.285750 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:21:52.285750 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:21:52.285750 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:21:52.285750 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:21:52.285750 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:21:52.285750 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:21:52.285750 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:21:52.285750 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:21:52.285750 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:21:52.285750 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:21:52.285750 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:21:52.285750 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:21:52.285750 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:21:52.287485 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:21:52.287485 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:21:52.287485 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:21:52.287485 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:21:52.287485 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:21:52.287485 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:21:52.287485 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:21:52.287485 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application with Lock( Sep 24 19:21:52.287485 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:21:52.287485 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:21:52.287485 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:21:52.287485 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:21:52.287485 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:21:52.287485 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:21:52.287485 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:21:52.287485 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:21:52.287485 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:21:52.296007 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:21:52.296007 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:21:52.296007 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Sep 24 19:21:52.296007 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 244/486] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Sep 24 19:21:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:21:52.300649 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb630c3-2ae2-44b3-aa11-a7cba9a6cc9a None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:52.325803 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac21a63-6a85-475a-a698-145af505de6a None None] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:52.373322 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8d3eb8-cd4e-40f1-8a27-fae18b59a8ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:52.374004 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8d3eb8-cd4e-40f1-8a27-fae18b59a8ec None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:52.374358 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8d3eb8-cd4e-40f1-8a27-fae18b59a8ec None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:52.374597 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8d3eb8-cd4e-40f1-8a27-fae18b59a8ec None admin] PATH_INFO: `/v3/roles/service` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:52.394111 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8d3eb8-cd4e-40f1-8a27-fae18b59a8ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:21:52.400121 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application [None req-3f8d3eb8-cd4e-40f1-8a27-fae18b59a8ec None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 24 19:21:52.400121 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:21:52.400121 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:21:52.400121 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:21:52.400121 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:21:52.400121 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:21:52.400121 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:21:52.400121 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:21:52.400121 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:21:52.400121 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:21:52.400121 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:21:52.400121 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:21:52.400121 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:21:52.400121 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:21:52.400121 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:21:52.400121 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:21:52.401378 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:21:52.401378 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:21:52.401378 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:21:52.401378 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:21:52.401378 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:21:52.401378 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:21:52.401378 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:21:52.401378 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:21:52.401378 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:21:52.401378 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:21:52.401378 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:21:52.401378 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application with Lock( Sep 24 19:21:52.401378 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:21:52.401378 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:21:52.401378 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:21:52.401378 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:21:52.404002 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:21:52.404002 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:21:52.404002 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:21:52.404002 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:21:52.404002 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:21:52.404002 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:21:52.404002 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:21:52.404002 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:21:52.404002 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:21:52.404002 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:21:52.404002 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 24 19:21:52.404002 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Sep 24 19:21:52.404002 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 243/487] 10.222.0.18 () {56 vars in 1102 bytes} [Sat Sep 24 19:21:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:21:52.404002 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8d3eb8-cd4e-40f1-8a27-fae18b59a8ec None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:52.484121 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:52.485553 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb630c3-2ae2-44b3-aa11-a7cba9a6cc9a None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:52.502387 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:52.540259 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4457e02c-6d95-40b8-bc09-53fc3987fce3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:52.541451 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4457e02c-6d95-40b8-bc09-53fc3987fce3 None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:52.542066 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4457e02c-6d95-40b8-bc09-53fc3987fce3 None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:52.542693 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4457e02c-6d95-40b8-bc09-53fc3987fce3 None admin] PATH_INFO: `/v3/domains` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:52.544113 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4457e02c-6d95-40b8-bc09-53fc3987fce3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:21:52.544873 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4457e02c-6d95-40b8-bc09-53fc3987fce3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:52.547574 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4457e02c-6d95-40b8-bc09-53fc3987fce3 None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:52.562594 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8d3eb8-cd4e-40f1-8a27-fae18b59a8ec None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:52.567997 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 245/488] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Sep 24 19:21:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:21:52.569293 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4457e02c-6d95-40b8-bc09-53fc3987fce3 None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:52.614449 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f469c7d6-5e4e-46a8-b2f9-e2066397b072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:52.615381 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f469c7d6-5e4e-46a8-b2f9-e2066397b072 None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:52.615870 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f469c7d6-5e4e-46a8-b2f9-e2066397b072 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:52.616337 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f469c7d6-5e4e-46a8-b2f9-e2066397b072 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:52.630797 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f469c7d6-5e4e-46a8-b2f9-e2066397b072 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:21:52.635911 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application [None req-f469c7d6-5e4e-46a8-b2f9-e2066397b072 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 24 19:21:52.635911 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:21:52.635911 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:21:52.635911 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:21:52.635911 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:21:52.635911 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:21:52.635911 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:21:52.635911 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:21:52.635911 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:21:52.635911 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:21:52.635911 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:21:52.635911 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:21:52.635911 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:21:52.635911 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:21:52.635911 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:21:52.635911 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:21:52.638057 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:21:52.638057 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:21:52.638057 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:21:52.638057 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:21:52.638057 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:21:52.638057 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:21:52.638057 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:21:52.638057 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:21:52.638057 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:21:52.638057 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:21:52.638057 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:21:52.638057 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application with Lock( Sep 24 19:21:52.638057 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:21:52.638057 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:21:52.638057 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:21:52.638057 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:21:52.640273 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:21:52.640273 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:21:52.640273 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:21:52.640273 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:21:52.640273 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:21:52.640273 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:21:52.640273 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:21:52.640273 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:21:52.640273 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:21:52.640273 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:21:52.640273 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 24 19:21:52.640273 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Sep 24 19:21:52.640273 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 244/489] 10.222.0.18 () {56 vars in 1102 bytes} [Sat Sep 24 19:21:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:21:52.640273 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f469c7d6-5e4e-46a8-b2f9-e2066397b072 None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:52.704154 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4457e02c-6d95-40b8-bc09-53fc3987fce3 None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:52.759107 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6749b428-3e66-4171-9337-b6e8637318c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:52.759988 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6749b428-3e66-4171-9337-b6e8637318c7 None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:52.760565 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6749b428-3e66-4171-9337-b6e8637318c7 None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:52.761043 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6749b428-3e66-4171-9337-b6e8637318c7 None admin] PATH_INFO: `/v3/roles` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:52.762316 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6749b428-3e66-4171-9337-b6e8637318c7 None admin] RBAC: Adding query filter params (name=service) {{(pid=88080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:21:52.763498 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6749b428-3e66-4171-9337-b6e8637318c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:52.765349 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6749b428-3e66-4171-9337-b6e8637318c7 None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:52.779687 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 246/490] 10.222.0.18 () {56 vars in 1103 bytes} [Sat Sep 24 19:21:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:21:52.782866 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6749b428-3e66-4171-9337-b6e8637318c7 None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:52.795063 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f469c7d6-5e4e-46a8-b2f9-e2066397b072 None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:52.799264 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:52.850323 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:52.851018 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64fa9ae-ff9a-46b5-8f6a-5e142f6289a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:52.852085 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64fa9ae-ff9a-46b5-8f6a-5e142f6289a5 None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:52.852564 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64fa9ae-ff9a-46b5-8f6a-5e142f6289a5 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:52.853011 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64fa9ae-ff9a-46b5-8f6a-5e142f6289a5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:52.869335 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64fa9ae-ff9a-46b5-8f6a-5e142f6289a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:21:52.875743 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application [None req-e64fa9ae-ff9a-46b5-8f6a-5e142f6289a5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 24 19:21:52.875743 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:21:52.875743 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:21:52.875743 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:21:52.875743 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:21:52.875743 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:21:52.875743 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:21:52.875743 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:21:52.875743 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:21:52.875743 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:21:52.875743 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:21:52.875743 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:21:52.875743 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:21:52.875743 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:21:52.875743 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:21:52.875743 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:21:52.877293 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:21:52.877293 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:21:52.877293 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:21:52.877293 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:21:52.877293 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:21:52.877293 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:21:52.877293 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:21:52.877293 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:21:52.877293 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:21:52.877293 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:21:52.877293 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:21:52.877293 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application with Lock( Sep 24 19:21:52.877293 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:21:52.877293 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:21:52.877293 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:21:52.877293 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:21:52.878817 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:21:52.878817 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:21:52.878817 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:21:52.878817 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:21:52.878817 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:21:52.878817 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:21:52.878817 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:21:52.878817 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:21:52.878817 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:21:52.878817 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:21:52.878817 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 24 19:21:52.878817 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Sep 24 19:21:52.878817 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 245/491] 10.222.0.18 () {56 vars in 1102 bytes} [Sat Sep 24 19:21:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:21:52.878817 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64fa9ae-ff9a-46b5-8f6a-5e142f6289a5 None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:52.957273 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6749b428-3e66-4171-9337-b6e8637318c7 None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:53.008795 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da1ff69-205e-4a54-9d3d-d76c8249233d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:53.009956 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da1ff69-205e-4a54-9d3d-d76c8249233d None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:53.010547 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da1ff69-205e-4a54-9d3d-d76c8249233d None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:53.010870 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da1ff69-205e-4a54-9d3d-d76c8249233d None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:53.011823 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64fa9ae-ff9a-46b5-8f6a-5e142f6289a5 None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:53.021579 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da1ff69-205e-4a54-9d3d-d76c8249233d None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:53.023270 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da1ff69-205e-4a54-9d3d-d76c8249233d None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:53.040253 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application [None req-1da1ff69-205e-4a54-9d3d-d76c8249233d None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 24 19:21:53.040253 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:21:53.040253 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:21:53.040253 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:21:53.040253 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:21:53.040253 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:21:53.040253 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:21:53.040253 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:21:53.040253 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:21:53.040253 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:21:53.040253 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:21:53.040253 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:21:53.040253 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 24 19:21:53.040253 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 24 19:21:53.040253 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 24 19:21:53.040253 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 24 19:21:53.042130 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:21:53.042130 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:21:53.042130 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 24 19:21:53.042130 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 19:21:53.042130 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 24 19:21:53.042130 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 19:21:53.042130 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:21:53.042130 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:21:53.042130 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:21:53.042130 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:21:53.042130 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:21:53.042130 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application with Lock( Sep 24 19:21:53.042130 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:21:53.042130 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:21:53.042130 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:21:53.042130 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:21:53.042130 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:21:53.042130 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:21:53.043552 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:21:53.043552 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:21:53.043552 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 24 19:21:53.043552 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 24 19:21:53.043552 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 24 19:21:53.043552 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 24 19:21:53.043552 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 24 19:21:53.043552 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 24 19:21:53.043552 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 24 19:21:53.043552 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Sep 24 19:21:53.043552 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 247/492] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Sep 24 19:21:52 2022] GET /identity/v3/users/cinder => generated 84 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:21:53.043552 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da1ff69-205e-4a54-9d3d-d76c8249233d None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:53.065417 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bcf094-38be-4554-85fa-be9de8e07368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:53.066464 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bcf094-38be-4554-85fa-be9de8e07368 None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:53.066953 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bcf094-38be-4554-85fa-be9de8e07368 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:53.067436 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bcf094-38be-4554-85fa-be9de8e07368 None admin] PATH_INFO: `/v3/roles` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:53.068612 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bcf094-38be-4554-85fa-be9de8e07368 None admin] RBAC: Adding query filter params (name=service) {{(pid=88081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:21:53.069245 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bcf094-38be-4554-85fa-be9de8e07368 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:53.071746 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bcf094-38be-4554-85fa-be9de8e07368 None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:53.083435 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 246/493] 10.222.0.18 () {56 vars in 1103 bytes} [Sat Sep 24 19:21:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:21:53.084611 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bcf094-38be-4554-85fa-be9de8e07368 None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:53.158889 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:53.194443 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:53.203646 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da1ff69-205e-4a54-9d3d-d76c8249233d None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:53.247550 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4f2f7d-b952-4359-926d-3051a8ce7146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:53.248283 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4f2f7d-b952-4359-926d-3051a8ce7146 None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:53.248597 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4f2f7d-b952-4359-926d-3051a8ce7146 None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:53.248887 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4f2f7d-b952-4359-926d-3051a8ce7146 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:53.262921 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bcf094-38be-4554-85fa-be9de8e07368 None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:53.263368 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4f2f7d-b952-4359-926d-3051a8ce7146 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:53.265968 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4f2f7d-b952-4359-926d-3051a8ce7146 None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:53.286771 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application [None req-2c4f2f7d-b952-4359-926d-3051a8ce7146 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:21:53.286771 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:21:53.286771 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:21:53.286771 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:21:53.286771 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:21:53.286771 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:21:53.286771 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:21:53.286771 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:21:53.286771 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:21:53.286771 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:21:53.286771 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:21:53.286771 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:21:53.286771 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:21:53.286771 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:21:53.286771 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:21:53.286771 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:21:53.288278 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:21:53.288278 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:21:53.288278 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:21:53.288278 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:21:53.288278 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:21:53.288278 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:21:53.288278 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:21:53.288278 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application with Lock( Sep 24 19:21:53.288278 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:21:53.288278 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:21:53.288278 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:21:53.288278 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:21:53.288278 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:21:53.288278 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:21:53.288278 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:21:53.288278 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:21:53.288278 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:21:53.289932 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:21:53.289932 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:21:53.289932 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Sep 24 19:21:53.289932 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 248/494] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Sep 24 19:21:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:21:53.289932 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4f2f7d-b952-4359-926d-3051a8ce7146 None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:53.321206 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1022d606-7746-44b2-bcc5-f425d69a5d65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:53.321974 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1022d606-7746-44b2-bcc5-f425d69a5d65 None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:53.322283 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1022d606-7746-44b2-bcc5-f425d69a5d65 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:53.322608 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1022d606-7746-44b2-bcc5-f425d69a5d65 None admin] PATH_INFO: `/v3/roles` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:53.323336 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1022d606-7746-44b2-bcc5-f425d69a5d65 None admin] RBAC: Adding query filter params (name=service) {{(pid=88081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:21:53.323675 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1022d606-7746-44b2-bcc5-f425d69a5d65 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:53.325328 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1022d606-7746-44b2-bcc5-f425d69a5d65 None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:53.344678 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 247/495] 10.222.0.18 () {56 vars in 1103 bytes} [Sat Sep 24 19:21:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:21:53.344678 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1022d606-7746-44b2-bcc5-f425d69a5d65 None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:53.424104 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4f2f7d-b952-4359-926d-3051a8ce7146 None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:53.442748 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:53.459115 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1022d606-7746-44b2-bcc5-f425d69a5d65 None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:53.471509 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795e0c57-df09-464b-895b-9127f14a3654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:53.472246 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795e0c57-df09-464b-895b-9127f14a3654 None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:53.472652 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795e0c57-df09-464b-895b-9127f14a3654 None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:53.473473 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795e0c57-df09-464b-895b-9127f14a3654 None admin] PATH_INFO: `/v3/users` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:53.474480 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795e0c57-df09-464b-895b-9127f14a3654 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=88080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:21:53.474931 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795e0c57-df09-464b-895b-9127f14a3654 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:53.476718 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795e0c57-df09-464b-895b-9127f14a3654 None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:53.511212 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2921abd3-d65c-436c-a262-68216f45b8c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:53.512772 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2921abd3-d65c-436c-a262-68216f45b8c7 None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:53.513280 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2921abd3-d65c-436c-a262-68216f45b8c7 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:53.513902 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2921abd3-d65c-436c-a262-68216f45b8c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:53.530136 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2921abd3-d65c-436c-a262-68216f45b8c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:53.532212 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 249/496] 10.222.0.18 () {56 vars in 1137 bytes} [Sat Sep 24 19:21:53 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:21:53.532713 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2921abd3-d65c-436c-a262-68216f45b8c7 None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:53.533068 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795e0c57-df09-464b-895b-9127f14a3654 None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:53.537161 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:53.558269 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application [None req-2921abd3-d65c-436c-a262-68216f45b8c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:21:53.558269 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:21:53.558269 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:21:53.558269 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:21:53.558269 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:21:53.558269 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:21:53.558269 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:21:53.558269 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:21:53.558269 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:21:53.558269 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:21:53.558269 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:21:53.558269 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:21:53.558269 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:21:53.558269 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:21:53.558269 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:21:53.558269 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:21:53.559505 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:21:53.559505 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:21:53.559505 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:21:53.559505 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:21:53.559505 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:21:53.559505 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:21:53.559505 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:21:53.559505 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application with Lock( Sep 24 19:21:53.559505 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:21:53.559505 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:21:53.559505 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:21:53.559505 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:21:53.559505 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:21:53.559505 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:21:53.559505 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:21:53.559505 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:21:53.559505 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:21:53.562744 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:21:53.562744 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:21:53.562744 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Sep 24 19:21:53.562744 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 248/497] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Sep 24 19:21:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:21:53.562744 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2921abd3-d65c-436c-a262-68216f45b8c7 None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:53.677811 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795e0c57-df09-464b-895b-9127f14a3654 None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:53.682731 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2921abd3-d65c-436c-a262-68216f45b8c7 None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:53.725443 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42306a23-0f8d-4a51-86af-7a09b25abe1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:53.726362 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42306a23-0f8d-4a51-86af-7a09b25abe1f None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:53.726789 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42306a23-0f8d-4a51-86af-7a09b25abe1f None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:53.727206 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42306a23-0f8d-4a51-86af-7a09b25abe1f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:53.733234 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc765459-9746-470d-a348-5b21e45e3555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:53.734779 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc765459-9746-470d-a348-5b21e45e3555 None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:53.735225 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc765459-9746-470d-a348-5b21e45e3555 None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:53.735683 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc765459-9746-470d-a348-5b21e45e3555 None admin] PATH_INFO: `/v3/domains` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:53.736461 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc765459-9746-470d-a348-5b21e45e3555 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:21:53.736817 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc765459-9746-470d-a348-5b21e45e3555 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:53.738659 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:53.738859 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc765459-9746-470d-a348-5b21e45e3555 None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:53.742057 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42306a23-0f8d-4a51-86af-7a09b25abe1f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:53.747387 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42306a23-0f8d-4a51-86af-7a09b25abe1f None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:53.756033 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 250/498] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Sep 24 19:21:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:21:53.756963 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc765459-9746-470d-a348-5b21e45e3555 None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:53.772092 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application [None req-42306a23-0f8d-4a51-86af-7a09b25abe1f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:21:53.772092 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:21:53.772092 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:21:53.772092 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:21:53.772092 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:21:53.772092 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:21:53.772092 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:21:53.772092 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:21:53.772092 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:21:53.772092 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:21:53.772092 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:21:53.772092 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:21:53.772092 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:21:53.772092 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:21:53.772092 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:21:53.772092 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:21:53.773803 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:21:53.773803 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:21:53.773803 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:21:53.773803 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:21:53.773803 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:21:53.773803 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:21:53.773803 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:21:53.773803 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application with Lock( Sep 24 19:21:53.773803 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:21:53.773803 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:21:53.773803 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:21:53.773803 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:21:53.773803 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:21:53.773803 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:21:53.773803 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:21:53.773803 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:21:53.773803 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:21:53.775518 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:21:53.775518 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:21:53.775518 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Sep 24 19:21:53.775518 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 249/499] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Sep 24 19:21:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:21:53.775518 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42306a23-0f8d-4a51-86af-7a09b25abe1f None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:53.855395 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:53.901625 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc765459-9746-470d-a348-5b21e45e3555 None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:53.908554 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42306a23-0f8d-4a51-86af-7a09b25abe1f None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:53.939505 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3745dd-9986-4d30-a926-5d57abcd048e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:53.940110 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3745dd-9986-4d30-a926-5d57abcd048e None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:53.940379 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3745dd-9986-4d30-a926-5d57abcd048e None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:53.940645 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3745dd-9986-4d30-a926-5d57abcd048e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:53.954934 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a2502b-09cc-400c-be7b-6b68de0a85e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:53.955853 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a2502b-09cc-400c-be7b-6b68de0a85e1 None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:53.956379 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a2502b-09cc-400c-be7b-6b68de0a85e1 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:53.956733 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a2502b-09cc-400c-be7b-6b68de0a85e1 None admin] PATH_INFO: `/v3/domains` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:53.958413 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a2502b-09cc-400c-be7b-6b68de0a85e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:21:53.958943 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a2502b-09cc-400c-be7b-6b68de0a85e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:53.960910 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a2502b-09cc-400c-be7b-6b68de0a85e1 None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:53.977326 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 250/500] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Sep 24 19:21:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:21:53.978859 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a2502b-09cc-400c-be7b-6b68de0a85e1 None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:54.026659 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3745dd-9986-4d30-a926-5d57abcd048e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:54.028145 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3745dd-9986-4d30-a926-5d57abcd048e None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:54.050899 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:54.111618 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a2502b-09cc-400c-be7b-6b68de0a85e1 None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:54.117062 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:54.159370 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08744072-44ec-4677-8b9b-468630b3859b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:54.160440 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08744072-44ec-4677-8b9b-468630b3859b None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:54.160760 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08744072-44ec-4677-8b9b-468630b3859b None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:54.161079 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08744072-44ec-4677-8b9b-468630b3859b None admin] PATH_INFO: `/v3/users/neutron` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:54.167242 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 251/501] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Sep 24 19:21:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 24 19:21:54.168147 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3745dd-9986-4d30-a926-5d57abcd048e None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:54.174529 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08744072-44ec-4677-8b9b-468630b3859b None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:54.176471 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08744072-44ec-4677-8b9b-468630b3859b None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:54.196386 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application [None req-08744072-44ec-4677-8b9b-468630b3859b None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 24 19:21:54.196386 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:21:54.196386 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:21:54.196386 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:21:54.196386 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:21:54.196386 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:21:54.196386 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:21:54.196386 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:21:54.196386 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:21:54.196386 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:21:54.196386 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:21:54.196386 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:21:54.196386 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 24 19:21:54.196386 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 24 19:21:54.196386 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 24 19:21:54.196386 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 24 19:21:54.197642 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:21:54.197642 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:21:54.197642 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 24 19:21:54.197642 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 19:21:54.197642 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 24 19:21:54.197642 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 19:21:54.197642 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:21:54.197642 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:21:54.197642 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:21:54.197642 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:21:54.197642 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:21:54.197642 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application with Lock( Sep 24 19:21:54.197642 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:21:54.197642 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:21:54.197642 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:21:54.197642 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:21:54.197642 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:21:54.197642 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:21:54.204362 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:21:54.204362 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:21:54.204362 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 24 19:21:54.204362 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 24 19:21:54.204362 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 24 19:21:54.204362 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 24 19:21:54.204362 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 24 19:21:54.204362 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 24 19:21:54.204362 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 24 19:21:54.204362 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Sep 24 19:21:54.204362 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 251/502] 10.222.0.18 () {56 vars in 1102 bytes} [Sat Sep 24 19:21:53 2022] GET /identity/v3/users/neutron => generated 85 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:21:54.204362 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08744072-44ec-4677-8b9b-468630b3859b None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:54.314578 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08744072-44ec-4677-8b9b-468630b3859b None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:54.325815 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3745dd-9986-4d30-a926-5d57abcd048e None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:54.330744 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:54.366144 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6112a20-3808-43ad-9cd6-55692721d72c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:54.366733 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6112a20-3808-43ad-9cd6-55692721d72c None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:54.367010 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6112a20-3808-43ad-9cd6-55692721d72c None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:54.367278 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6112a20-3808-43ad-9cd6-55692721d72c None admin] PATH_INFO: `/v3/domains` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:54.367956 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6112a20-3808-43ad-9cd6-55692721d72c None admin] RBAC: Adding query filter params (name=Default) {{(pid=88080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:21:54.368197 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6112a20-3808-43ad-9cd6-55692721d72c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:54.369558 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6112a20-3808-43ad-9cd6-55692721d72c None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:54.372098 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8bbd1d-5964-43e5-953b-05dab6dfe19a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:54.373282 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8bbd1d-5964-43e5-953b-05dab6dfe19a None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:54.373779 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8bbd1d-5964-43e5-953b-05dab6dfe19a None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:54.374304 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8bbd1d-5964-43e5-953b-05dab6dfe19a None admin] PATH_INFO: `/v3/users/nova` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:54.382999 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 252/503] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Sep 24 19:21:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:21:54.383846 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6112a20-3808-43ad-9cd6-55692721d72c None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:54.390365 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8bbd1d-5964-43e5-953b-05dab6dfe19a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:54.394067 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8bbd1d-5964-43e5-953b-05dab6dfe19a None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:54.415104 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application [None req-7b8bbd1d-5964-43e5-953b-05dab6dfe19a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 24 19:21:54.415104 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:21:54.415104 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:21:54.415104 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:21:54.415104 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:21:54.415104 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:21:54.415104 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:21:54.415104 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:21:54.415104 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:21:54.415104 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:21:54.415104 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:21:54.415104 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:21:54.415104 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 24 19:21:54.415104 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 24 19:21:54.415104 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 24 19:21:54.415104 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 24 19:21:54.416925 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:21:54.416925 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:21:54.416925 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 24 19:21:54.416925 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 19:21:54.416925 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 24 19:21:54.416925 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 19:21:54.416925 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:21:54.416925 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:21:54.416925 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:21:54.416925 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:21:54.416925 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:21:54.416925 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application with Lock( Sep 24 19:21:54.416925 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:21:54.416925 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:21:54.416925 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:21:54.416925 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:21:54.416925 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:21:54.416925 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:21:54.419111 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:21:54.419111 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:21:54.419111 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 24 19:21:54.419111 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 24 19:21:54.419111 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 24 19:21:54.419111 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 24 19:21:54.419111 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 24 19:21:54.419111 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 24 19:21:54.419111 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 24 19:21:54.419111 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Sep 24 19:21:54.419750 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:54.419822 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 252/504] 10.222.0.18 () {56 vars in 1093 bytes} [Sat Sep 24 19:21:54 2022] GET /identity/v3/users/nova => generated 82 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:21:54.419822 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8bbd1d-5964-43e5-953b-05dab6dfe19a None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:54.523228 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6112a20-3808-43ad-9cd6-55692721d72c None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:54.548371 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8bbd1d-5964-43e5-953b-05dab6dfe19a None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:54.567126 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9ff547-0a3f-4599-a7b5-dffa0981956a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:54.567693 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9ff547-0a3f-4599-a7b5-dffa0981956a None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:54.568017 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9ff547-0a3f-4599-a7b5-dffa0981956a None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:54.568341 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9ff547-0a3f-4599-a7b5-dffa0981956a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:54.581710 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9ff547-0a3f-4599-a7b5-dffa0981956a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:54.583405 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9ff547-0a3f-4599-a7b5-dffa0981956a None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:54.602843 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application [None req-ec9ff547-0a3f-4599-a7b5-dffa0981956a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:21:54.602843 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:21:54.602843 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:21:54.602843 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:21:54.602843 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:21:54.602843 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:21:54.602843 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:21:54.602843 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:21:54.602843 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:21:54.602843 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:21:54.602843 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:21:54.602843 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:21:54.602843 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:21:54.602843 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:21:54.602843 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:21:54.602843 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:21:54.604680 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:21:54.604680 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:21:54.604680 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:21:54.604680 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:21:54.604680 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:21:54.604680 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:21:54.604680 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:21:54.604680 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application with Lock( Sep 24 19:21:54.604680 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:21:54.604680 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:21:54.604680 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:21:54.604680 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:21:54.604680 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:21:54.604680 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:21:54.604680 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:21:54.604680 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:21:54.604680 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:21:54.606507 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:21:54.606507 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:21:54.606507 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Sep 24 19:21:54.606507 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 253/505] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Sep 24 19:21:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:21:54.606507 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9ff547-0a3f-4599-a7b5-dffa0981956a None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:54.609343 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e005c771-cfc0-464e-8d13-f431eead141b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:54.610370 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e005c771-cfc0-464e-8d13-f431eead141b None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:54.611105 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e005c771-cfc0-464e-8d13-f431eead141b None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:54.611570 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e005c771-cfc0-464e-8d13-f431eead141b None admin] PATH_INFO: `/v3/users` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:54.612611 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e005c771-cfc0-464e-8d13-f431eead141b None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=88081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:21:54.613102 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e005c771-cfc0-464e-8d13-f431eead141b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:54.615445 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e005c771-cfc0-464e-8d13-f431eead141b None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:54.658901 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 253/506] 10.222.0.18 () {56 vars in 1139 bytes} [Sat Sep 24 19:21:54 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:21:54.659956 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e005c771-cfc0-464e-8d13-f431eead141b None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:54.698220 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:54.744603 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:54.783601 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9ff547-0a3f-4599-a7b5-dffa0981956a None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:54.788266 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e005c771-cfc0-464e-8d13-f431eead141b None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:54.824692 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23eff7e-1553-4364-b3cb-942bdd95e29a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:54.825245 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23eff7e-1553-4364-b3cb-942bdd95e29a None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:54.825534 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23eff7e-1553-4364-b3cb-942bdd95e29a None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:54.825952 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23eff7e-1553-4364-b3cb-942bdd95e29a None admin] PATH_INFO: `/v3/users/glance` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:54.835730 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23eff7e-1553-4364-b3cb-942bdd95e29a None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:54.837313 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23eff7e-1553-4364-b3cb-942bdd95e29a None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:54.838330 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0fb7ab-96c2-4e74-8aac-da19de9670a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:54.839008 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0fb7ab-96c2-4e74-8aac-da19de9670a8 None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:54.839326 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0fb7ab-96c2-4e74-8aac-da19de9670a8 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:54.839756 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0fb7ab-96c2-4e74-8aac-da19de9670a8 None admin] PATH_INFO: `/v3/users` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:54.840653 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0fb7ab-96c2-4e74-8aac-da19de9670a8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:21:54.841172 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0fb7ab-96c2-4e74-8aac-da19de9670a8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:54.843304 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0fb7ab-96c2-4e74-8aac-da19de9670a8 None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:54.851699 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application [None req-b23eff7e-1553-4364-b3cb-942bdd95e29a None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 24 19:21:54.851699 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:21:54.851699 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:21:54.851699 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:21:54.851699 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:21:54.851699 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:21:54.851699 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:21:54.851699 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:21:54.851699 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:21:54.851699 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:21:54.851699 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:21:54.851699 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:21:54.851699 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 24 19:21:54.851699 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 24 19:21:54.851699 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 24 19:21:54.851699 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 24 19:21:54.852714 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:21:54.852714 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:21:54.852714 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 24 19:21:54.852714 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 19:21:54.852714 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 24 19:21:54.852714 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 19:21:54.852714 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:21:54.852714 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:21:54.852714 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:21:54.852714 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:21:54.852714 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:21:54.852714 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application with Lock( Sep 24 19:21:54.852714 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:21:54.852714 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:21:54.852714 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:21:54.852714 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:21:54.852714 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:21:54.852714 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:21:54.854023 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:21:54.854023 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:21:54.854023 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 24 19:21:54.854023 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 24 19:21:54.854023 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 24 19:21:54.854023 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 24 19:21:54.854023 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 24 19:21:54.854023 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 24 19:21:54.854023 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 24 19:21:54.854023 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Sep 24 19:21:54.854023 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 254/507] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Sep 24 19:21:54 2022] GET /identity/v3/users/glance => generated 84 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:21:54.854023 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23eff7e-1553-4364-b3cb-942bdd95e29a None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:54.879785 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 254/508] 10.222.0.18 () {56 vars in 1133 bytes} [Sat Sep 24 19:21:54 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:21:54.879785 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0fb7ab-96c2-4e74-8aac-da19de9670a8 None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:54.987156 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23eff7e-1553-4364-b3cb-942bdd95e29a None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:55.002637 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:55.019671 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0fb7ab-96c2-4e74-8aac-da19de9670a8 None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:55.027066 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d82c3e8-364a-4cf6-901c-c62a9fc82a7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:55.027687 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d82c3e8-364a-4cf6-901c-c62a9fc82a7c None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:55.028050 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d82c3e8-364a-4cf6-901c-c62a9fc82a7c None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:55.028324 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d82c3e8-364a-4cf6-901c-c62a9fc82a7c None admin] PATH_INFO: `/v3/domains` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:55.028997 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d82c3e8-364a-4cf6-901c-c62a9fc82a7c None admin] RBAC: Adding query filter params (name=Default) {{(pid=88080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:21:55.029300 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d82c3e8-364a-4cf6-901c-c62a9fc82a7c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:55.030758 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d82c3e8-364a-4cf6-901c-c62a9fc82a7c None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:55.034793 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:55.051180 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 255/509] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Sep 24 19:21:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:21:55.053874 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d82c3e8-364a-4cf6-901c-c62a9fc82a7c None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:55.075133 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4686e56a-a12f-42e2-a049-1d097526d996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:55.075848 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4686e56a-a12f-42e2-a049-1d097526d996 None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:55.076212 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4686e56a-a12f-42e2-a049-1d097526d996 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:55.076516 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4686e56a-a12f-42e2-a049-1d097526d996 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:55.168417 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4686e56a-a12f-42e2-a049-1d097526d996 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:55.170116 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4686e56a-a12f-42e2-a049-1d097526d996 None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:55.218163 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d82c3e8-364a-4cf6-901c-c62a9fc82a7c None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:55.279127 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ceca59-0acc-495b-9c17-cd538c7c90c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:55.279792 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ceca59-0acc-495b-9c17-cd538c7c90c1 None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:55.280101 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ceca59-0acc-495b-9c17-cd538c7c90c1 None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:55.280443 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ceca59-0acc-495b-9c17-cd538c7c90c1 None admin] PATH_INFO: `/v3/users` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:55.281808 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ceca59-0acc-495b-9c17-cd538c7c90c1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=88080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:21:55.282124 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ceca59-0acc-495b-9c17-cd538c7c90c1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:55.283863 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ceca59-0acc-495b-9c17-cd538c7c90c1 None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:55.295875 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:55.305422 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 256/510] 10.222.0.18 () {56 vars in 1137 bytes} [Sat Sep 24 19:21:55 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:21:55.306425 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ceca59-0acc-495b-9c17-cd538c7c90c1 None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:55.312488 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 255/511] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Sep 24 19:21:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 24 19:21:55.313572 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4686e56a-a12f-42e2-a049-1d097526d996 None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:55.395380 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:55.440057 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4686e56a-a12f-42e2-a049-1d097526d996 None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:55.452793 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ceca59-0acc-495b-9c17-cd538c7c90c1 None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:55.491498 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e6a7de-710f-47df-8912-c8ae28d3808e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:55.492112 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e6a7de-710f-47df-8912-c8ae28d3808e None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:55.492384 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e6a7de-710f-47df-8912-c8ae28d3808e None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:55.492647 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e6a7de-710f-47df-8912-c8ae28d3808e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:55.507023 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e970c1-42e3-4a2e-baab-49a692809653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:55.508321 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e970c1-42e3-4a2e-baab-49a692809653 None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:55.508762 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e970c1-42e3-4a2e-baab-49a692809653 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:55.509357 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e970c1-42e3-4a2e-baab-49a692809653 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:55.518109 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e970c1-42e3-4a2e-baab-49a692809653 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:55.519600 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e970c1-42e3-4a2e-baab-49a692809653 None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:55.532697 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application [None req-c7e970c1-42e3-4a2e-baab-49a692809653 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 19:21:55.532697 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:21:55.532697 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:21:55.532697 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:21:55.532697 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:21:55.532697 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:21:55.532697 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:21:55.532697 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:21:55.532697 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:21:55.532697 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:21:55.532697 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:21:55.532697 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:21:55.532697 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 24 19:21:55.532697 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 24 19:21:55.532697 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 24 19:21:55.533854 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 24 19:21:55.533854 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:21:55.533854 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:21:55.533854 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:21:55.533854 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:21:55.533854 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:21:55.533854 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:21:55.533854 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:21:55.533854 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application with Lock( Sep 24 19:21:55.533854 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:21:55.533854 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:21:55.533854 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:21:55.533854 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:21:55.533854 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:21:55.533854 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:21:55.533854 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:21:55.533854 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:21:55.534930 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 24 19:21:55.534930 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 24 19:21:55.534930 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 24 19:21:55.534930 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 24 19:21:55.534930 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 24 19:21:55.534930 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 24 19:21:55.534930 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 19:21:55.534930 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Sep 24 19:21:55.534930 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 256/512] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Sep 24 19:21:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:21:55.534930 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e970c1-42e3-4a2e-baab-49a692809653 None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:55.584005 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e6a7de-710f-47df-8912-c8ae28d3808e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:55.585689 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e6a7de-710f-47df-8912-c8ae28d3808e None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:55.599270 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:55.658696 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:55.674693 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e970c1-42e3-4a2e-baab-49a692809653 None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:55.713461 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 257/513] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Sep 24 19:21:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 24 19:21:55.714390 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e6a7de-710f-47df-8912-c8ae28d3808e None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:55.724710 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5701e145-9aed-4dc6-bf65-a30d2cbbc61d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:55.725695 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5701e145-9aed-4dc6-bf65-a30d2cbbc61d None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:55.726210 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5701e145-9aed-4dc6-bf65-a30d2cbbc61d None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:55.726696 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5701e145-9aed-4dc6-bf65-a30d2cbbc61d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:55.835582 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5701e145-9aed-4dc6-bf65-a30d2cbbc61d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:55.837071 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5701e145-9aed-4dc6-bf65-a30d2cbbc61d None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:55.837607 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e6a7de-710f-47df-8912-c8ae28d3808e None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:55.894940 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11fc701-792b-4df7-b3d7-0ed4d5cdf8ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:55.895787 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11fc701-792b-4df7-b3d7-0ed4d5cdf8ba None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:55.896326 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11fc701-792b-4df7-b3d7-0ed4d5cdf8ba None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:55.896856 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11fc701-792b-4df7-b3d7-0ed4d5cdf8ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:55.899700 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:55.910370 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11fc701-792b-4df7-b3d7-0ed4d5cdf8ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:55.911755 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11fc701-792b-4df7-b3d7-0ed4d5cdf8ba None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:55.928232 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application [None req-e11fc701-792b-4df7-b3d7-0ed4d5cdf8ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:21:55.928232 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:21:55.928232 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:21:55.928232 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:21:55.928232 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:21:55.928232 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:21:55.928232 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:21:55.928232 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:21:55.928232 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:21:55.928232 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:21:55.928232 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:21:55.928232 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:21:55.928232 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:21:55.928232 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:21:55.928232 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:21:55.928232 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:21:55.930578 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:21:55.930578 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:21:55.930578 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:21:55.930578 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:21:55.930578 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:21:55.930578 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:21:55.930578 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:21:55.930578 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application with Lock( Sep 24 19:21:55.930578 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:21:55.930578 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:21:55.930578 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:21:55.930578 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:21:55.930578 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:21:55.930578 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:21:55.930578 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:21:55.930578 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:21:55.930578 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:21:55.932943 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:21:55.932943 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:21:55.932943 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Sep 24 19:21:55.934029 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 258/514] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Sep 24 19:21:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:21:55.936408 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11fc701-792b-4df7-b3d7-0ed4d5cdf8ba None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:55.956397 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:55.966802 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 257/515] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Sep 24 19:21:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 24 19:21:55.967972 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5701e145-9aed-4dc6-bf65-a30d2cbbc61d None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:56.061779 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11fc701-792b-4df7-b3d7-0ed4d5cdf8ba None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:56.103811 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711e6035-5175-4cf5-93f1-e4e108bd1923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:56.104440 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711e6035-5175-4cf5-93f1-e4e108bd1923 None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:56.104787 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711e6035-5175-4cf5-93f1-e4e108bd1923 None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:56.105062 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711e6035-5175-4cf5-93f1-e4e108bd1923 None admin] PATH_INFO: `/v3/projects` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:56.105766 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711e6035-5175-4cf5-93f1-e4e108bd1923 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:21:56.106115 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711e6035-5175-4cf5-93f1-e4e108bd1923 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:56.107597 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711e6035-5175-4cf5-93f1-e4e108bd1923 None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:56.121247 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5701e145-9aed-4dc6-bf65-a30d2cbbc61d None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:56.127620 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 259/516] 10.222.0.18 () {56 vars in 1148 bytes} [Sat Sep 24 19:21:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:21:56.128471 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711e6035-5175-4cf5-93f1-e4e108bd1923 None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:56.177979 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c137b8-c150-46b3-9370-f9bfffcb5680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:56.178946 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c137b8-c150-46b3-9370-f9bfffcb5680 None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:56.179416 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c137b8-c150-46b3-9370-f9bfffcb5680 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:56.179865 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c137b8-c150-46b3-9370-f9bfffcb5680 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:56.196909 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c137b8-c150-46b3-9370-f9bfffcb5680 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:56.198488 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c137b8-c150-46b3-9370-f9bfffcb5680 None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:56.207778 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:56.212020 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:56.215441 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application [None req-f5c137b8-c150-46b3-9370-f9bfffcb5680 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:21:56.215441 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:21:56.215441 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:21:56.215441 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:21:56.215441 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:21:56.215441 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:21:56.215441 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:21:56.215441 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:21:56.215441 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:21:56.215441 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:21:56.215441 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:21:56.215441 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:21:56.215441 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:21:56.215441 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:21:56.215441 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:21:56.215441 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:21:56.217119 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:21:56.217119 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:21:56.217119 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:21:56.217119 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:21:56.217119 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:21:56.217119 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:21:56.217119 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:21:56.217119 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application with Lock( Sep 24 19:21:56.217119 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:21:56.217119 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:21:56.217119 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:21:56.217119 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:21:56.217119 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:21:56.217119 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:21:56.217119 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:21:56.217119 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:21:56.217119 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:21:56.219507 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:21:56.219507 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:21:56.219507 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Sep 24 19:21:56.219507 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 258/517] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Sep 24 19:21:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:21:56.219507 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c137b8-c150-46b3-9370-f9bfffcb5680 None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:56.257386 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711e6035-5175-4cf5-93f1-e4e108bd1923 None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:56.294278 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571e170c-fb69-4375-a9d0-191035d5d8e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:56.294906 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571e170c-fb69-4375-a9d0-191035d5d8e3 None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:56.295186 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571e170c-fb69-4375-a9d0-191035d5d8e3 None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:56.295456 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571e170c-fb69-4375-a9d0-191035d5d8e3 None admin] PATH_INFO: `/v3/domains` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:56.296162 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571e170c-fb69-4375-a9d0-191035d5d8e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:21:56.296988 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571e170c-fb69-4375-a9d0-191035d5d8e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:56.298470 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571e170c-fb69-4375-a9d0-191035d5d8e3 None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:56.310983 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 260/518] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Sep 24 19:21:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:21:56.311640 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571e170c-fb69-4375-a9d0-191035d5d8e3 None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:56.370791 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c137b8-c150-46b3-9370-f9bfffcb5680 None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:56.419875 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe12620f-e45b-423a-8abf-a87415da45af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:56.420927 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe12620f-e45b-423a-8abf-a87415da45af None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:56.421411 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe12620f-e45b-423a-8abf-a87415da45af None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:56.422518 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe12620f-e45b-423a-8abf-a87415da45af None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:56.435952 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571e170c-fb69-4375-a9d0-191035d5d8e3 None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:56.440017 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe12620f-e45b-423a-8abf-a87415da45af None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:56.441480 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe12620f-e45b-423a-8abf-a87415da45af None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:56.457571 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application [None req-fe12620f-e45b-423a-8abf-a87415da45af None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:21:56.457571 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:21:56.457571 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:21:56.457571 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:21:56.457571 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:21:56.457571 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:21:56.457571 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:21:56.457571 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:21:56.457571 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:21:56.457571 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:21:56.457571 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:21:56.457571 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:21:56.457571 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:21:56.457571 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:21:56.457571 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:21:56.457571 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:21:56.459619 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:21:56.459619 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:21:56.459619 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:21:56.459619 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:21:56.459619 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:21:56.459619 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:21:56.459619 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:21:56.459619 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application with Lock( Sep 24 19:21:56.459619 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:21:56.459619 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:21:56.459619 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:21:56.459619 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:21:56.459619 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:21:56.459619 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:21:56.459619 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:21:56.459619 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:21:56.459619 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:21:56.461273 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:21:56.461273 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:21:56.461273 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Sep 24 19:21:56.461273 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 259/519] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Sep 24 19:21:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:21:56.461273 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe12620f-e45b-423a-8abf-a87415da45af None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:56.480543 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:56.492011 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c23273-8097-4663-b737-26da20b6b731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:56.492633 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c23273-8097-4663-b737-26da20b6b731 None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:56.492905 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c23273-8097-4663-b737-26da20b6b731 None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:56.493169 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c23273-8097-4663-b737-26da20b6b731 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:56.493990 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c23273-8097-4663-b737-26da20b6b731 None admin] RBAC: Adding query filter params (role.id=0b2e96b9c7cc4c83babfba292ed46c61, scope.project.id=9dfa5c2c17244006bdd629ec81553f1a, user.id=cd2db56b901e4fb08a0ec849cc9136f9) {{(pid=88080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:21:56.494365 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c23273-8097-4663-b737-26da20b6b731 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:56.495930 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c23273-8097-4663-b737-26da20b6b731 None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:56.502741 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 261/520] 10.222.0.18 () {56 vars in 1374 bytes} [Sat Sep 24 19:21:56 2022] GET /identity/v3/role_assignments?user.id=cd2db56b901e4fb08a0ec849cc9136f9&scope.project.id=9dfa5c2c17244006bdd629ec81553f1a&role.id=0b2e96b9c7cc4c83babfba292ed46c61 => generated 259 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:21:56.503643 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c23273-8097-4663-b737-26da20b6b731 None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:56.568519 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:56.685540 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe12620f-e45b-423a-8abf-a87415da45af None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:56.706714 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c23273-8097-4663-b737-26da20b6b731 None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:56.763194 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa31c7e-01d7-46e9-9c9e-c41f6b65c40d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:56.764404 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa31c7e-01d7-46e9-9c9e-c41f6b65c40d None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:56.764891 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa31c7e-01d7-46e9-9c9e-c41f6b65c40d None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:56.765968 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa31c7e-01d7-46e9-9c9e-c41f6b65c40d None admin] PATH_INFO: `/v3/domains` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:56.767472 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa31c7e-01d7-46e9-9c9e-c41f6b65c40d None admin] RBAC: Adding query filter params (name=Default) {{(pid=88081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:21:56.767472 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa31c7e-01d7-46e9-9c9e-c41f6b65c40d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:56.769957 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa31c7e-01d7-46e9-9c9e-c41f6b65c40d None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:56.770440 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e38553-5a1d-4538-b00c-c06b857709e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:56.771779 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e38553-5a1d-4538-b00c-c06b857709e4 None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:56.771970 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e38553-5a1d-4538-b00c-c06b857709e4 None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:56.774322 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e38553-5a1d-4538-b00c-c06b857709e4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:56.786110 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e38553-5a1d-4538-b00c-c06b857709e4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:56.787581 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 260/521] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Sep 24 19:21:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:21:56.788261 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa31c7e-01d7-46e9-9c9e-c41f6b65c40d None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:56.790440 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e38553-5a1d-4538-b00c-c06b857709e4 None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:56.813925 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application [None req-c8e38553-5a1d-4538-b00c-c06b857709e4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 19:21:56.813925 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:21:56.813925 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:21:56.813925 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:21:56.813925 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:21:56.813925 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:21:56.813925 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:21:56.813925 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:21:56.813925 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:21:56.813925 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:21:56.813925 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:21:56.813925 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:21:56.813925 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 24 19:21:56.813925 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 24 19:21:56.813925 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 24 19:21:56.815459 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 24 19:21:56.815459 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:21:56.815459 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:21:56.815459 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:21:56.815459 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:21:56.815459 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:21:56.815459 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:21:56.815459 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:21:56.815459 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application with Lock( Sep 24 19:21:56.815459 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:21:56.815459 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:21:56.815459 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:21:56.815459 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:21:56.815459 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:21:56.815459 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:21:56.815459 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:21:56.815459 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:21:56.816972 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 24 19:21:56.816972 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 24 19:21:56.816972 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 24 19:21:56.816972 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 24 19:21:56.816972 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 24 19:21:56.816972 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 24 19:21:56.816972 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 19:21:56.816972 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Sep 24 19:21:56.820556 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 262/522] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Sep 24 19:21:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:21:56.822533 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e38553-5a1d-4538-b00c-c06b857709e4 None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:56.899650 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:56.961596 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e38553-5a1d-4538-b00c-c06b857709e4 None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:56.984655 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa31c7e-01d7-46e9-9c9e-c41f6b65c40d None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:57.005037 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d530a7-dea8-462b-a277-257f5f9f7855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:57.005690 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d530a7-dea8-462b-a277-257f5f9f7855 None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:57.006190 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d530a7-dea8-462b-a277-257f5f9f7855 None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:57.006596 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d530a7-dea8-462b-a277-257f5f9f7855 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:57.008353 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:57.018889 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d530a7-dea8-462b-a277-257f5f9f7855 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:57.020737 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d530a7-dea8-462b-a277-257f5f9f7855 None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:57.036397 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d70b17c-b542-4e4a-b0ef-9f05ece3fc66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:57.037256 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d70b17c-b542-4e4a-b0ef-9f05ece3fc66 None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:57.037691 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d70b17c-b542-4e4a-b0ef-9f05ece3fc66 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:57.038163 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d70b17c-b542-4e4a-b0ef-9f05ece3fc66 None admin] PATH_INFO: `/v3/domains` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:57.039098 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d70b17c-b542-4e4a-b0ef-9f05ece3fc66 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:21:57.039594 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d70b17c-b542-4e4a-b0ef-9f05ece3fc66 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:57.040439 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application [None req-e0d530a7-dea8-462b-a277-257f5f9f7855 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 19:21:57.040439 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:21:57.040439 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:21:57.040439 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:21:57.040439 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:21:57.040439 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:21:57.040439 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:21:57.040439 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:21:57.040439 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:21:57.040439 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:21:57.040439 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:21:57.040439 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:21:57.040439 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 24 19:21:57.040439 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 24 19:21:57.040439 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 24 19:21:57.049687 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 24 19:21:57.049687 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:21:57.049687 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:21:57.049687 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:21:57.049687 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:21:57.049687 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:21:57.049687 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:21:57.049687 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:21:57.049687 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application with Lock( Sep 24 19:21:57.049687 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:21:57.049687 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:21:57.049687 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:21:57.049687 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:21:57.049687 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:21:57.049687 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:21:57.049687 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:21:57.049687 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:21:57.051420 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 24 19:21:57.051420 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 24 19:21:57.051420 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 24 19:21:57.051420 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 24 19:21:57.051420 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 24 19:21:57.051420 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 24 19:21:57.051420 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 19:21:57.051420 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Sep 24 19:21:57.052206 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d70b17c-b542-4e4a-b0ef-9f05ece3fc66 None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:57.052507 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 263/523] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Sep 24 19:21:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:21:57.052507 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d530a7-dea8-462b-a277-257f5f9f7855 None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:57.060170 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 261/524] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Sep 24 19:21:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:21:57.061485 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d70b17c-b542-4e4a-b0ef-9f05ece3fc66 None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:57.199131 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d70b17c-b542-4e4a-b0ef-9f05ece3fc66 None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:57.214224 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d530a7-dea8-462b-a277-257f5f9f7855 None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:57.232036 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:57.241050 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c29695-afc1-44d7-8cf9-d679c2d36a86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:57.241777 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c29695-afc1-44d7-8cf9-d679c2d36a86 None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:57.242069 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c29695-afc1-44d7-8cf9-d679c2d36a86 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:57.242331 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c29695-afc1-44d7-8cf9-d679c2d36a86 None admin] PATH_INFO: `/v3/projects` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:57.243028 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c29695-afc1-44d7-8cf9-d679c2d36a86 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:21:57.243329 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c29695-afc1-44d7-8cf9-d679c2d36a86 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:57.244863 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c29695-afc1-44d7-8cf9-d679c2d36a86 None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:57.260009 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c54db4d-7e4e-457f-b2a6-6889d8d8e422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:57.260610 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c54db4d-7e4e-457f-b2a6-6889d8d8e422 None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:57.260887 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c54db4d-7e4e-457f-b2a6-6889d8d8e422 None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:57.261164 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c54db4d-7e4e-457f-b2a6-6889d8d8e422 None admin] PATH_INFO: `/v3/projects` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:57.261882 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c54db4d-7e4e-457f-b2a6-6889d8d8e422 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:21:57.262228 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c54db4d-7e4e-457f-b2a6-6889d8d8e422 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:57.264153 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c54db4d-7e4e-457f-b2a6-6889d8d8e422 None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:57.273339 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 262/525] 10.222.0.18 () {56 vars in 1148 bytes} [Sat Sep 24 19:21:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:21:57.273339 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c29695-afc1-44d7-8cf9-d679c2d36a86 None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:57.285854 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 264/526] 10.222.0.18 () {56 vars in 1148 bytes} [Sat Sep 24 19:21:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:21:57.285854 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c54db4d-7e4e-457f-b2a6-6889d8d8e422 None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:57.324206 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:57.435301 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c29695-afc1-44d7-8cf9-d679c2d36a86 None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:57.443216 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c54db4d-7e4e-457f-b2a6-6889d8d8e422 None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:57.498630 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b7261d-e339-4bb5-8664-1c26bf708a9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:57.498630 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b7261d-e339-4bb5-8664-1c26bf708a9b None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:57.498630 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b7261d-e339-4bb5-8664-1c26bf708a9b None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:57.498630 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b7261d-e339-4bb5-8664-1c26bf708a9b None admin] PATH_INFO: `/v3/projects/service` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:57.507020 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f170f504-c37d-4c1c-9d43-40ab1ea5470a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:57.507830 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f170f504-c37d-4c1c-9d43-40ab1ea5470a None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:57.508087 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f170f504-c37d-4c1c-9d43-40ab1ea5470a None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:57.508430 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f170f504-c37d-4c1c-9d43-40ab1ea5470a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:57.508830 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b7261d-e339-4bb5-8664-1c26bf708a9b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:57.509437 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f170f504-c37d-4c1c-9d43-40ab1ea5470a None admin] RBAC: Adding query filter params (role.id=0b2e96b9c7cc4c83babfba292ed46c61, scope.project.id=9dfa5c2c17244006bdd629ec81553f1a, user.id=0ab73abe1c6e4b25a17281f4cd8e97e9) {{(pid=88080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:21:57.509923 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f170f504-c37d-4c1c-9d43-40ab1ea5470a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:57.510759 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b7261d-e339-4bb5-8664-1c26bf708a9b None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:57.511565 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f170f504-c37d-4c1c-9d43-40ab1ea5470a None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:57.525947 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 265/527] 10.222.0.18 () {56 vars in 1374 bytes} [Sat Sep 24 19:21:57 2022] GET /identity/v3/role_assignments?user.id=0ab73abe1c6e4b25a17281f4cd8e97e9&scope.project.id=9dfa5c2c17244006bdd629ec81553f1a&role.id=0b2e96b9c7cc4c83babfba292ed46c61 => generated 259 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:21:57.525947 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f170f504-c37d-4c1c-9d43-40ab1ea5470a None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:57.526329 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application [None req-b7b7261d-e339-4bb5-8664-1c26bf708a9b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 19:21:57.526329 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:21:57.526329 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:21:57.526329 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:21:57.526329 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:21:57.526329 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:21:57.526329 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:21:57.526329 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:21:57.526329 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:21:57.526329 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:21:57.526329 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:21:57.526329 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:21:57.526329 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 24 19:21:57.526329 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 24 19:21:57.526329 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 24 19:21:57.527601 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 24 19:21:57.527601 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:21:57.527601 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:21:57.527601 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:21:57.527601 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:21:57.527601 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:21:57.527601 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:21:57.527601 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:21:57.527601 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application with Lock( Sep 24 19:21:57.527601 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:21:57.527601 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:21:57.527601 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:21:57.527601 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:21:57.527601 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:21:57.527601 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:21:57.527601 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:21:57.527601 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:21:57.528949 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 24 19:21:57.528949 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 24 19:21:57.528949 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 24 19:21:57.528949 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 24 19:21:57.528949 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 24 19:21:57.528949 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 24 19:21:57.528949 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 19:21:57.528949 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Sep 24 19:21:57.528949 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 263/528] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Sep 24 19:21:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:21:57.538421 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b7261d-e339-4bb5-8664-1c26bf708a9b None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:57.577535 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:57.680892 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f170f504-c37d-4c1c-9d43-40ab1ea5470a None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:57.684164 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:57.699234 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b7261d-e339-4bb5-8664-1c26bf708a9b None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:57.729444 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ead198-0d1d-42ad-9807-5a30bf31fe4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:57.730153 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ead198-0d1d-42ad-9807-5a30bf31fe4a None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:57.730431 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ead198-0d1d-42ad-9807-5a30bf31fe4a None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:57.730706 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ead198-0d1d-42ad-9807-5a30bf31fe4a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:57.731575 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ead198-0d1d-42ad-9807-5a30bf31fe4a None admin] RBAC: Adding query filter params (role.id=0b2e96b9c7cc4c83babfba292ed46c61, scope.project.id=9dfa5c2c17244006bdd629ec81553f1a, user.id=2ef291c173794b49ade9469a5ef72e08) {{(pid=88080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:21:57.731897 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ead198-0d1d-42ad-9807-5a30bf31fe4a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:57.733733 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ead198-0d1d-42ad-9807-5a30bf31fe4a None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:57.745892 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 266/529] 10.222.0.18 () {56 vars in 1374 bytes} [Sat Sep 24 19:21:57 2022] GET /identity/v3/role_assignments?user.id=2ef291c173794b49ade9469a5ef72e08&scope.project.id=9dfa5c2c17244006bdd629ec81553f1a&role.id=0b2e96b9c7cc4c83babfba292ed46c61 => generated 259 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:21:57.764640 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0658c1-d6dc-4375-a73b-0b1e95106038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:57.766423 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0658c1-d6dc-4375-a73b-0b1e95106038 None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:57.766981 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0658c1-d6dc-4375-a73b-0b1e95106038 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:57.767465 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0658c1-d6dc-4375-a73b-0b1e95106038 None admin] PATH_INFO: `/v3/projects` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:57.768514 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0658c1-d6dc-4375-a73b-0b1e95106038 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:21:57.769120 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0658c1-d6dc-4375-a73b-0b1e95106038 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:57.771015 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0658c1-d6dc-4375-a73b-0b1e95106038 None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:57.796034 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 264/530] 10.222.0.18 () {56 vars in 1148 bytes} [Sat Sep 24 19:21:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:21:57.802782 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ead198-0d1d-42ad-9807-5a30bf31fe4a None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:57.946462 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ead198-0d1d-42ad-9807-5a30bf31fe4a None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:57.950460 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:21:57.997178 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51170a3d-a350-4b51-abd5-be0ac085e9a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:57.997800 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51170a3d-a350-4b51-abd5-be0ac085e9a0 None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:57.998122 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51170a3d-a350-4b51-abd5-be0ac085e9a0 None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:57.998395 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51170a3d-a350-4b51-abd5-be0ac085e9a0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:57.999145 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51170a3d-a350-4b51-abd5-be0ac085e9a0 None admin] RBAC: Adding query filter params (role.id=0b2e96b9c7cc4c83babfba292ed46c61, scope.project.id=9dfa5c2c17244006bdd629ec81553f1a, user.id=135ee6a2c657412ba6d65a51403ef4d6) {{(pid=88080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:21:57.999967 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51170a3d-a350-4b51-abd5-be0ac085e9a0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:21:58.001467 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51170a3d-a350-4b51-abd5-be0ac085e9a0 None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:21:58.008667 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 267/531] 10.222.0.18 () {56 vars in 1374 bytes} [Sat Sep 24 19:21:57 2022] GET /identity/v3/role_assignments?user.id=135ee6a2c657412ba6d65a51403ef4d6&scope.project.id=9dfa5c2c17244006bdd629ec81553f1a&role.id=0b2e96b9c7cc4c83babfba292ed46c61 => generated 259 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:21:59.282979 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed77007c-0dc6-4e6f-9b8a-b4b8623778cd None None] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:59.284108 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed77007c-0dc6-4e6f-9b8a-b4b8623778cd None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:59.284643 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed77007c-0dc6-4e6f-9b8a-b4b8623778cd None None] PATH_INFO: `/` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:59.286549 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 265/532] 10.222.0.18 () {54 vars in 927 bytes} [Sat Sep 24 19:21:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:21:59.293138 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e33058d-4614-4202-9e7f-d129ab744877 None None] REQUEST_METHOD: `POST` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:59.294232 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e33058d-4614-4202-9e7f-d129ab744877 None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:59.294771 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e33058d-4614-4202-9e7f-d129ab744877 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:59.316254 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.auth.core [None req-9e33058d-4614-4202-9e7f-d129ab744877 None None] MFA Rules not processed for user `3dbbb9909cec43ff99c1c3682f016ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=88080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:21:59.317903 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.fernet_utils [None req-9e33058d-4614-4202-9e7f-d129ab744877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:21:59.395155 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 268/533] 10.222.0.18 () {58 vars in 1024 bytes} [Sat Sep 24 19:21:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:21:59.737657 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed77007c-0dc6-4e6f-9b8a-b4b8623778cd None None] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:21:59.862943 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed77007c-0dc6-4e6f-9b8a-b4b8623778cd None None] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:21:59.906377 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861c6b23-87ea-44b5-ae73-98fe0a6acc2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:21:59.907015 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861c6b23-87ea-44b5-ae73-98fe0a6acc2f None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:21:59.907290 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861c6b23-87ea-44b5-ae73-98fe0a6acc2f None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:21:59.907554 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861c6b23-87ea-44b5-ae73-98fe0a6acc2f None admin] PATH_INFO: `/v3/roles/service` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:21:59.918480 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861c6b23-87ea-44b5-ae73-98fe0a6acc2f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:21:59.924127 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application [None req-861c6b23-87ea-44b5-ae73-98fe0a6acc2f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 24 19:21:59.924127 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:21:59.924127 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:21:59.924127 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:21:59.924127 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:21:59.924127 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:21:59.924127 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:21:59.924127 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:21:59.924127 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:21:59.924127 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:21:59.924127 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:21:59.924127 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:21:59.924127 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:21:59.924127 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:21:59.924127 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:21:59.924127 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:21:59.925135 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:21:59.925135 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:21:59.925135 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:21:59.925135 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:21:59.925135 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:21:59.925135 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:21:59.925135 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:21:59.925135 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:21:59.925135 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:21:59.925135 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:21:59.925135 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:21:59.925135 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application with Lock( Sep 24 19:21:59.925135 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:21:59.925135 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:21:59.925135 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:21:59.925135 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:21:59.926055 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:21:59.926055 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:21:59.926055 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:21:59.926055 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:21:59.926055 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:21:59.926055 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:21:59.926055 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:21:59.926055 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:21:59.926055 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:21:59.926055 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:21:59.926055 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 24 19:21:59.926055 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Sep 24 19:21:59.926055 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 266/534] 10.222.0.18 () {56 vars in 1102 bytes} [Sat Sep 24 19:21:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:21:59.933494 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e33058d-4614-4202-9e7f-d129ab744877 None None] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:00.047628 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:22:00.060250 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e33058d-4614-4202-9e7f-d129ab744877 None None] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:00.111288 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2922de51-6b04-49c4-955f-7004b9d8c43a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:00.111960 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2922de51-6b04-49c4-955f-7004b9d8c43a None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:00.112240 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2922de51-6b04-49c4-955f-7004b9d8c43a None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:00.112542 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2922de51-6b04-49c4-955f-7004b9d8c43a None admin] PATH_INFO: `/v3/roles` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:00.113476 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2922de51-6b04-49c4-955f-7004b9d8c43a None admin] RBAC: Adding query filter params (name=service) {{(pid=88080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:22:00.113806 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2922de51-6b04-49c4-955f-7004b9d8c43a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:00.115870 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2922de51-6b04-49c4-955f-7004b9d8c43a None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:00.128838 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 269/535] 10.222.0.18 () {56 vars in 1103 bytes} [Sat Sep 24 19:21:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:22:00.134285 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861c6b23-87ea-44b5-ae73-98fe0a6acc2f None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:00.151888 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:22:00.311489 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861c6b23-87ea-44b5-ae73-98fe0a6acc2f None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:00.373301 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a0af19-1e49-4f33-90d4-28adde3babef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:00.375330 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a0af19-1e49-4f33-90d4-28adde3babef None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:00.376011 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a0af19-1e49-4f33-90d4-28adde3babef None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:00.376687 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a0af19-1e49-4f33-90d4-28adde3babef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:00.398547 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a0af19-1e49-4f33-90d4-28adde3babef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:00.401597 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a0af19-1e49-4f33-90d4-28adde3babef None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:00.428931 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application [None req-e3a0af19-1e49-4f33-90d4-28adde3babef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:22:00.428931 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:22:00.428931 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:22:00.428931 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:22:00.428931 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:22:00.428931 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:22:00.428931 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:22:00.428931 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:22:00.428931 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:22:00.428931 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:22:00.428931 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:22:00.428931 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:22:00.428931 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:22:00.428931 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:22:00.428931 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:22:00.428931 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:22:00.430799 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:22:00.430799 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:22:00.430799 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:22:00.430799 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:22:00.430799 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:22:00.430799 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:22:00.430799 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:22:00.430799 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application with Lock( Sep 24 19:22:00.430799 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:22:00.430799 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:22:00.430799 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:22:00.430799 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:22:00.430799 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:22:00.430799 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:22:00.430799 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:22:00.430799 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:22:00.430799 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:22:00.432458 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:22:00.432458 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:22:00.432458 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Sep 24 19:22:00.432458 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 267/536] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Sep 24 19:22:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:22:00.444645 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2922de51-6b04-49c4-955f-7004b9d8c43a None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:00.599066 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2922de51-6b04-49c4-955f-7004b9d8c43a None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:00.657239 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60d70d5-f0f1-4d7d-8afa-c2f9e98cbcdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:00.658896 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60d70d5-f0f1-4d7d-8afa-c2f9e98cbcdb None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:00.659706 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60d70d5-f0f1-4d7d-8afa-c2f9e98cbcdb None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:00.660585 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60d70d5-f0f1-4d7d-8afa-c2f9e98cbcdb None admin] PATH_INFO: `/v3/domains` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:00.662221 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60d70d5-f0f1-4d7d-8afa-c2f9e98cbcdb None admin] RBAC: Adding query filter params (name=Default) {{(pid=88080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:22:00.663028 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60d70d5-f0f1-4d7d-8afa-c2f9e98cbcdb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:00.665200 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60d70d5-f0f1-4d7d-8afa-c2f9e98cbcdb None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:00.684783 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 270/537] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Sep 24 19:22:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:22:00.690334 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a0af19-1e49-4f33-90d4-28adde3babef None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:00.707847 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec550688-d5fb-4dfd-ad48-21d2ed58f052 None None] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:00.708751 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec550688-d5fb-4dfd-ad48-21d2ed58f052 None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:00.709316 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec550688-d5fb-4dfd-ad48-21d2ed58f052 None None] PATH_INFO: `/` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:00.711611 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 271/538] 10.222.0.18 () {54 vars in 927 bytes} [Sat Sep 24 19:22:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:22:00.717046 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0571875d-f179-46c5-a66c-2bcb022934f9 None None] REQUEST_METHOD: `POST` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:00.717328 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0571875d-f179-46c5-a66c-2bcb022934f9 None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:00.717597 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0571875d-f179-46c5-a66c-2bcb022934f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:00.740028 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.auth.core [None req-0571875d-f179-46c5-a66c-2bcb022934f9 None None] MFA Rules not processed for user `3dbbb9909cec43ff99c1c3682f016ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=88080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:22:00.741917 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.fernet_utils [None req-0571875d-f179-46c5-a66c-2bcb022934f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:22:00.752586 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:22:00.783230 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:22:00.840428 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 272/539] 10.222.0.18 () {58 vars in 1024 bytes} [Sat Sep 24 19:22:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 24 19:22:00.868609 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a0af19-1e49-4f33-90d4-28adde3babef None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:00.915508 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e07bd57-a0a8-4a27-9c10-10ba3fb856e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:00.916157 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e07bd57-a0a8-4a27-9c10-10ba3fb856e5 None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:00.916441 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e07bd57-a0a8-4a27-9c10-10ba3fb856e5 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:00.916777 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e07bd57-a0a8-4a27-9c10-10ba3fb856e5 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:00.925458 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e07bd57-a0a8-4a27-9c10-10ba3fb856e5 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:00.927017 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e07bd57-a0a8-4a27-9c10-10ba3fb856e5 None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:00.940057 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application [None req-0e07bd57-a0a8-4a27-9c10-10ba3fb856e5 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 24 19:22:00.940057 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:22:00.940057 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:22:00.940057 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:22:00.940057 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:22:00.940057 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:22:00.940057 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:22:00.940057 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:22:00.940057 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:22:00.940057 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:22:00.940057 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:22:00.940057 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:22:00.940057 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 24 19:22:00.940057 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 24 19:22:00.940057 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 24 19:22:00.940057 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 24 19:22:00.941795 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:22:00.941795 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:22:00.941795 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 24 19:22:00.941795 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 19:22:00.941795 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 24 19:22:00.941795 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 19:22:00.941795 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:22:00.941795 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:22:00.941795 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:22:00.941795 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:22:00.941795 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:22:00.941795 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application with Lock( Sep 24 19:22:00.941795 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:22:00.941795 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:22:00.941795 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:22:00.941795 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:22:00.941795 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:22:00.941795 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:22:00.943546 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:22:00.943546 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:22:00.943546 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 24 19:22:00.943546 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 24 19:22:00.943546 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 24 19:22:00.943546 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 24 19:22:00.943546 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 24 19:22:00.943546 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 24 19:22:00.943546 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 24 19:22:00.943546 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Sep 24 19:22:00.943546 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 268/540] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Sep 24 19:22:00 2022] GET /identity/v3/users/cinder => generated 84 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 19:22:00.947613 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0571875d-f179-46c5-a66c-2bcb022934f9 None None] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:00.981604 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deef8ca9-d048-4cfb-b03e-9fa242dfc9c3 None None] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:00.982046 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deef8ca9-d048-4cfb-b03e-9fa242dfc9c3 None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:00.982309 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deef8ca9-d048-4cfb-b03e-9fa242dfc9c3 None None] PATH_INFO: `/` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:00.985888 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 269/541] 10.222.0.18 () {54 vars in 927 bytes} [Sat Sep 24 19:22:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 24 19:22:00.993775 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a327d37-9f4e-47fd-b4af-19301955a243 None None] REQUEST_METHOD: `POST` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:00.994455 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a327d37-9f4e-47fd-b4af-19301955a243 None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:00.995004 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a327d37-9f4e-47fd-b4af-19301955a243 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:01.028388 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.auth.core [None req-9a327d37-9f4e-47fd-b4af-19301955a243 None None] MFA Rules not processed for user `3dbbb9909cec43ff99c1c3682f016ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=88081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:22:01.031377 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.fernet_utils [None req-9a327d37-9f4e-47fd-b4af-19301955a243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:22:01.102971 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0571875d-f179-46c5-a66c-2bcb022934f9 None None] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:01.123480 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 270/542] 10.222.0.18 () {58 vars in 1024 bytes} [Sat Sep 24 19:22:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:22:01.125767 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2df8298-27e8-4955-80f7-e044c9b293f9 None None] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:01.126286 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2df8298-27e8-4955-80f7-e044c9b293f9 None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:01.126748 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2df8298-27e8-4955-80f7-e044c9b293f9 None None] PATH_INFO: `/` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:01.132928 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 271/543] 10.222.0.18 () {54 vars in 927 bytes} [Sat Sep 24 19:22:01 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:22:01.134682 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0f75a9-0aca-4be9-a2d1-6dac399c8db6 None None] REQUEST_METHOD: `POST` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:01.135177 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0f75a9-0aca-4be9-a2d1-6dac399c8db6 None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:01.135633 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0f75a9-0aca-4be9-a2d1-6dac399c8db6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:01.157288 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.auth.core [None req-fe0f75a9-0aca-4be9-a2d1-6dac399c8db6 None None] MFA Rules not processed for user `3dbbb9909cec43ff99c1c3682f016ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=88081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:22:01.159016 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.fernet_utils [None req-fe0f75a9-0aca-4be9-a2d1-6dac399c8db6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:22:01.178151 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083e534a-0d51-4679-96ca-41ca9ff75147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:01.179052 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083e534a-0d51-4679-96ca-41ca9ff75147 None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:01.179450 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083e534a-0d51-4679-96ca-41ca9ff75147 None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:01.179854 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083e534a-0d51-4679-96ca-41ca9ff75147 None admin] PATH_INFO: `/v3/users` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:01.181472 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083e534a-0d51-4679-96ca-41ca9ff75147 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=88080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:22:01.181920 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083e534a-0d51-4679-96ca-41ca9ff75147 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:01.183639 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083e534a-0d51-4679-96ca-41ca9ff75147 None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:01.218246 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 273/544] 10.222.0.18 () {56 vars in 1137 bytes} [Sat Sep 24 19:22:00 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:22:01.226445 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083e534a-0d51-4679-96ca-41ca9ff75147 None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:01.228844 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:22:01.232042 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:22:01.245778 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 272/545] 10.222.0.18 () {58 vars in 1024 bytes} [Sat Sep 24 19:22:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:22:01.246930 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0f75a9-0aca-4be9-a2d1-6dac399c8db6 None None] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:01.365966 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083e534a-0d51-4679-96ca-41ca9ff75147 None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:01.425161 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a2eea1-4bf0-4157-9694-e5542da00f55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:01.427564 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a2eea1-4bf0-4157-9694-e5542da00f55 None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:01.428098 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a2eea1-4bf0-4157-9694-e5542da00f55 None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:01.428513 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a2eea1-4bf0-4157-9694-e5542da00f55 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:01.433896 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0f75a9-0aca-4be9-a2d1-6dac399c8db6 None None] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:01.453781 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a2eea1-4bf0-4157-9694-e5542da00f55 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:01.456620 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a2eea1-4bf0-4157-9694-e5542da00f55 None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:01.482792 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application [None req-f5a2eea1-4bf0-4157-9694-e5542da00f55 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:22:01.482792 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:22:01.482792 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:22:01.482792 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:22:01.482792 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:22:01.482792 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:22:01.482792 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:22:01.482792 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:22:01.482792 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:22:01.482792 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:22:01.482792 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:22:01.482792 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:22:01.482792 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:22:01.482792 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:22:01.482792 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:22:01.482792 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:22:01.484300 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:22:01.484300 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:22:01.484300 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:22:01.484300 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:22:01.484300 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:22:01.484300 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:22:01.484300 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:22:01.484300 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application with Lock( Sep 24 19:22:01.484300 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:22:01.484300 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:22:01.484300 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:22:01.484300 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:22:01.484300 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:22:01.484300 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:22:01.484300 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:22:01.484300 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:22:01.484300 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:22:01.485149 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:22:01.485149 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:22:01.485149 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Sep 24 19:22:01.485310 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcce2e4-4d6c-44b9-aa5c-2a8e59e6ae62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:01.485310 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcce2e4-4d6c-44b9-aa5c-2a8e59e6ae62 None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:01.486224 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcce2e4-4d6c-44b9-aa5c-2a8e59e6ae62 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:01.486779 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcce2e4-4d6c-44b9-aa5c-2a8e59e6ae62 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:01.487924 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 274/546] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Sep 24 19:22:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:22:01.497880 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a2eea1-4bf0-4157-9694-e5542da00f55 None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:01.512101 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcce2e4-4d6c-44b9-aa5c-2a8e59e6ae62 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:22:01.518970 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application [None req-6dcce2e4-4d6c-44b9-aa5c-2a8e59e6ae62 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 24 19:22:01.518970 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:22:01.518970 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:22:01.518970 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:22:01.518970 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:22:01.518970 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:22:01.518970 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:22:01.518970 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:22:01.518970 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:22:01.518970 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:22:01.518970 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:22:01.518970 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:22:01.518970 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:22:01.518970 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:22:01.518970 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:22:01.518970 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:22:01.520718 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:22:01.520718 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:22:01.520718 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:22:01.520718 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:22:01.520718 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:22:01.520718 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:22:01.520718 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:22:01.520718 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:22:01.520718 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:22:01.520718 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:22:01.520718 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:22:01.520718 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application with Lock( Sep 24 19:22:01.520718 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:22:01.520718 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:22:01.520718 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:22:01.520718 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:22:01.522260 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:22:01.522260 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:22:01.522260 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:22:01.522260 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:22:01.522260 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:22:01.522260 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:22:01.522260 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:22:01.522260 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:22:01.522260 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:22:01.522260 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:22:01.522260 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 24 19:22:01.522260 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Sep 24 19:22:01.522260 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 273/547] 10.222.0.18 () {56 vars in 1102 bytes} [Sat Sep 24 19:22:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:22:01.522260 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcce2e4-4d6c-44b9-aa5c-2a8e59e6ae62 None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:01.568496 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:22:01.598527 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:22:01.644151 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a2eea1-4bf0-4157-9694-e5542da00f55 None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:01.689865 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcce2e4-4d6c-44b9-aa5c-2a8e59e6ae62 None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:01.705472 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991b77a1-66b1-40dc-8195-cfd361728c31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:01.706553 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991b77a1-66b1-40dc-8195-cfd361728c31 None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:01.706922 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991b77a1-66b1-40dc-8195-cfd361728c31 None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:01.707451 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991b77a1-66b1-40dc-8195-cfd361728c31 None admin] PATH_INFO: `/v3/domains` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:01.708606 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991b77a1-66b1-40dc-8195-cfd361728c31 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:22:01.709150 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991b77a1-66b1-40dc-8195-cfd361728c31 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:01.711792 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991b77a1-66b1-40dc-8195-cfd361728c31 None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:01.727706 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1984e838-eba4-41ed-b929-a32f24d9e412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:01.728355 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1984e838-eba4-41ed-b929-a32f24d9e412 None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:01.728628 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1984e838-eba4-41ed-b929-a32f24d9e412 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:01.728895 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1984e838-eba4-41ed-b929-a32f24d9e412 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:01.734650 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 275/548] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Sep 24 19:22:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:22:01.735894 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991b77a1-66b1-40dc-8195-cfd361728c31 None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:01.748607 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1984e838-eba4-41ed-b929-a32f24d9e412 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:22:01.758432 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application [None req-1984e838-eba4-41ed-b929-a32f24d9e412 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 24 19:22:01.758432 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:22:01.758432 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:22:01.758432 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:22:01.758432 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:22:01.758432 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:22:01.758432 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:22:01.758432 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:22:01.758432 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:22:01.758432 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:22:01.758432 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:22:01.758432 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:22:01.758432 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:22:01.758432 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:22:01.758432 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:22:01.758432 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:22:01.759548 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:22:01.759548 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:22:01.759548 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:22:01.759548 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:22:01.759548 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:22:01.759548 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:22:01.759548 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:22:01.759548 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:22:01.759548 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:22:01.759548 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:22:01.759548 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:22:01.759548 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application with Lock( Sep 24 19:22:01.759548 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:22:01.759548 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:22:01.759548 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:22:01.759548 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:22:01.760395 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:22:01.760395 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:22:01.760395 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:22:01.760395 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:22:01.760395 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:22:01.760395 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:22:01.760395 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:22:01.760395 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:22:01.760395 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:22:01.760395 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:22:01.760395 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 24 19:22:01.760395 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Sep 24 19:22:01.760395 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 274/549] 10.222.0.18 () {56 vars in 1102 bytes} [Sat Sep 24 19:22:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:22:01.761408 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1984e838-eba4-41ed-b929-a32f24d9e412 None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:01.870277 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991b77a1-66b1-40dc-8195-cfd361728c31 None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:01.892765 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:22:01.896746 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1984e838-eba4-41ed-b929-a32f24d9e412 None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:01.901234 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:22:01.925333 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6690e2ae-4e04-4524-91e6-991e7960121c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:01.926137 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6690e2ae-4e04-4524-91e6-991e7960121c None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:01.926413 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6690e2ae-4e04-4524-91e6-991e7960121c None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:01.926684 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6690e2ae-4e04-4524-91e6-991e7960121c None admin] PATH_INFO: `/v3/roles` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:01.927400 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6690e2ae-4e04-4524-91e6-991e7960121c None admin] RBAC: Adding query filter params (name=service) {{(pid=88080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:22:01.927701 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6690e2ae-4e04-4524-91e6-991e7960121c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:01.929120 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6690e2ae-4e04-4524-91e6-991e7960121c None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:01.940526 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 276/550] 10.222.0.18 () {56 vars in 1103 bytes} [Sat Sep 24 19:22:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:22:01.942926 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6690e2ae-4e04-4524-91e6-991e7960121c None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:01.954786 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e072d275-b377-4953-b35b-af48f5adfc29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:01.955673 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e072d275-b377-4953-b35b-af48f5adfc29 None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:01.956017 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e072d275-b377-4953-b35b-af48f5adfc29 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:01.956250 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e072d275-b377-4953-b35b-af48f5adfc29 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:01.969941 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e072d275-b377-4953-b35b-af48f5adfc29 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:22:01.974995 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application [None req-e072d275-b377-4953-b35b-af48f5adfc29 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 24 19:22:01.974995 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:22:01.974995 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:22:01.974995 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:22:01.974995 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:22:01.974995 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:22:01.974995 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:22:01.974995 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:22:01.974995 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:22:01.974995 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:22:01.974995 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:22:01.974995 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:22:01.974995 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:22:01.974995 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:22:01.974995 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:22:01.974995 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:22:01.977268 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:22:01.977268 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:22:01.977268 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:22:01.977268 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:22:01.977268 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:22:01.977268 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:22:01.977268 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:22:01.977268 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:22:01.977268 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:22:01.977268 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:22:01.977268 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:22:01.977268 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application with Lock( Sep 24 19:22:01.977268 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:22:01.977268 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:22:01.977268 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:22:01.977268 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:22:01.981511 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:22:01.981511 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:22:01.981511 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:22:01.981511 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:22:01.981511 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:22:01.981511 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:22:01.981511 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:22:01.981511 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:22:01.981511 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:22:01.981511 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:22:01.981511 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 24 19:22:01.981511 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Sep 24 19:22:01.981511 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 275/551] 10.222.0.18 () {56 vars in 1102 bytes} [Sat Sep 24 19:22:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:22:01.981511 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e072d275-b377-4953-b35b-af48f5adfc29 None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:02.070864 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6690e2ae-4e04-4524-91e6-991e7960121c None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:02.093814 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e072d275-b377-4953-b35b-af48f5adfc29 None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:02.112418 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba321aeb-f2a6-4f09-8c79-a3fd51665497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:02.113225 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba321aeb-f2a6-4f09-8c79-a3fd51665497 None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:02.113686 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba321aeb-f2a6-4f09-8c79-a3fd51665497 None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:02.114068 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba321aeb-f2a6-4f09-8c79-a3fd51665497 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:02.127593 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba321aeb-f2a6-4f09-8c79-a3fd51665497 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:02.130731 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693cd98f-efdd-442b-9970-44d643c281bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:02.131448 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693cd98f-efdd-442b-9970-44d643c281bd None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:02.131831 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693cd98f-efdd-442b-9970-44d643c281bd None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:02.132043 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693cd98f-efdd-442b-9970-44d643c281bd None admin] PATH_INFO: `/v3/roles` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:02.132484 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba321aeb-f2a6-4f09-8c79-a3fd51665497 None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:02.132832 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693cd98f-efdd-442b-9970-44d643c281bd None admin] RBAC: Adding query filter params (name=service) {{(pid=88081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:22:02.133138 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693cd98f-efdd-442b-9970-44d643c281bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:02.134549 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693cd98f-efdd-442b-9970-44d643c281bd None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:02.145245 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 276/552] 10.222.0.18 () {56 vars in 1103 bytes} [Sat Sep 24 19:22:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:22:02.146413 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693cd98f-efdd-442b-9970-44d643c281bd None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:02.153290 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application [None req-ba321aeb-f2a6-4f09-8c79-a3fd51665497 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 19:22:02.153290 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:22:02.153290 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:22:02.153290 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:22:02.153290 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:22:02.153290 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:22:02.153290 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:22:02.153290 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:22:02.153290 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:22:02.153290 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:22:02.153290 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:22:02.153290 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:22:02.153290 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 24 19:22:02.153290 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 24 19:22:02.153290 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 24 19:22:02.154393 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 24 19:22:02.154393 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:22:02.154393 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:22:02.154393 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:22:02.154393 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:22:02.154393 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:22:02.154393 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:22:02.154393 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:22:02.154393 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application with Lock( Sep 24 19:22:02.154393 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:22:02.154393 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:22:02.154393 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:22:02.154393 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:22:02.154393 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:22:02.154393 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:22:02.154393 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:22:02.154393 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:22:02.156019 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 24 19:22:02.156019 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 24 19:22:02.156019 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 24 19:22:02.156019 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 24 19:22:02.156019 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 24 19:22:02.156019 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 24 19:22:02.156019 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 19:22:02.156019 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Sep 24 19:22:02.156019 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 277/553] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Sep 24 19:22:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:22:02.156613 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba321aeb-f2a6-4f09-8c79-a3fd51665497 None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:02.185263 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:22:02.205666 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:22:02.279700 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693cd98f-efdd-442b-9970-44d643c281bd None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:02.296932 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba321aeb-f2a6-4f09-8c79-a3fd51665497 None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:02.316911 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0505e2-0fab-4581-ba91-38eeca22b09a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:02.317550 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0505e2-0fab-4581-ba91-38eeca22b09a None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:02.317822 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0505e2-0fab-4581-ba91-38eeca22b09a None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:02.318115 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0505e2-0fab-4581-ba91-38eeca22b09a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:02.331201 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0505e2-0fab-4581-ba91-38eeca22b09a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:02.332873 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0505e2-0fab-4581-ba91-38eeca22b09a None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:02.343587 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccc8db5-005f-4fc0-85bf-2d03a0b198f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:02.344376 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccc8db5-005f-4fc0-85bf-2d03a0b198f2 None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:02.344809 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccc8db5-005f-4fc0-85bf-2d03a0b198f2 None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:02.345182 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccc8db5-005f-4fc0-85bf-2d03a0b198f2 None admin] PATH_INFO: `/v3/roles` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:02.346214 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccc8db5-005f-4fc0-85bf-2d03a0b198f2 None admin] RBAC: Adding query filter params (name=service) {{(pid=88080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:22:02.346643 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccc8db5-005f-4fc0-85bf-2d03a0b198f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:02.348491 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccc8db5-005f-4fc0-85bf-2d03a0b198f2 None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:02.349694 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application [None req-3c0505e2-0fab-4581-ba91-38eeca22b09a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:22:02.349694 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:22:02.349694 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:22:02.349694 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:22:02.349694 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:22:02.349694 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:22:02.349694 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:22:02.349694 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:22:02.349694 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:22:02.349694 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:22:02.349694 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:22:02.349694 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:22:02.349694 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:22:02.349694 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:22:02.349694 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:22:02.349694 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:22:02.350947 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:22:02.350947 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:22:02.350947 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:22:02.350947 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:22:02.350947 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:22:02.350947 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:22:02.350947 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:22:02.350947 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application with Lock( Sep 24 19:22:02.350947 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:22:02.350947 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:22:02.350947 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:22:02.350947 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:22:02.350947 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:22:02.350947 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:22:02.350947 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:22:02.350947 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:22:02.350947 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:22:02.352017 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:22:02.352017 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:22:02.352017 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Sep 24 19:22:02.352017 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 277/554] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Sep 24 19:22:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:22:02.352017 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0505e2-0fab-4581-ba91-38eeca22b09a None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:02.362750 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 278/555] 10.222.0.18 () {56 vars in 1103 bytes} [Sat Sep 24 19:22:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:22:02.363600 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccc8db5-005f-4fc0-85bf-2d03a0b198f2 None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:02.445211 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:22:02.473482 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:22:02.474806 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0505e2-0fab-4581-ba91-38eeca22b09a None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:02.479924 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccc8db5-005f-4fc0-85bf-2d03a0b198f2 None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:02.512632 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b6a7e3-4a99-4a7d-a115-0a4cd6c44ce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:02.513453 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b6a7e3-4a99-4a7d-a115-0a4cd6c44ce6 None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:02.514152 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b6a7e3-4a99-4a7d-a115-0a4cd6c44ce6 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:02.514429 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b6a7e3-4a99-4a7d-a115-0a4cd6c44ce6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:02.525267 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718bd95b-bd6d-4e21-a85f-a395fbee69d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:02.525895 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718bd95b-bd6d-4e21-a85f-a395fbee69d4 None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:02.526188 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718bd95b-bd6d-4e21-a85f-a395fbee69d4 None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:02.526499 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718bd95b-bd6d-4e21-a85f-a395fbee69d4 None admin] PATH_INFO: `/v3/projects` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:02.527205 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718bd95b-bd6d-4e21-a85f-a395fbee69d4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:22:02.527452 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b6a7e3-4a99-4a7d-a115-0a4cd6c44ce6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:02.527596 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718bd95b-bd6d-4e21-a85f-a395fbee69d4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:02.528904 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718bd95b-bd6d-4e21-a85f-a395fbee69d4 None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:02.529076 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b6a7e3-4a99-4a7d-a115-0a4cd6c44ce6 None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:02.544580 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application [None req-f3b6a7e3-4a99-4a7d-a115-0a4cd6c44ce6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:22:02.544580 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:22:02.544580 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:22:02.544580 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:22:02.544580 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:22:02.544580 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:22:02.544580 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:22:02.544580 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:22:02.544580 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:22:02.544580 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:22:02.544580 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:22:02.544580 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:22:02.544580 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:22:02.544580 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:22:02.544580 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:22:02.544580 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:22:02.545608 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:22:02.545608 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:22:02.545608 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:22:02.545608 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:22:02.545608 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:22:02.545608 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:22:02.545608 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:22:02.545608 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application with Lock( Sep 24 19:22:02.545608 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:22:02.545608 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:22:02.545608 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:22:02.545608 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:22:02.545608 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:22:02.545608 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:22:02.545608 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:22:02.545608 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:22:02.545608 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:22:02.547426 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:22:02.547426 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:22:02.547426 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Sep 24 19:22:02.547426 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 278/556] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Sep 24 19:22:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:22:02.547426 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b6a7e3-4a99-4a7d-a115-0a4cd6c44ce6 None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:02.557249 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 279/557] 10.222.0.18 () {56 vars in 1148 bytes} [Sat Sep 24 19:22:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:22:02.557249 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718bd95b-bd6d-4e21-a85f-a395fbee69d4 None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:02.666442 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b6a7e3-4a99-4a7d-a115-0a4cd6c44ce6 None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:02.699150 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:22:02.702224 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718bd95b-bd6d-4e21-a85f-a395fbee69d4 None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:02.706943 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce71fc1b-9ee5-4811-8140-ad815654e92b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:02.707635 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce71fc1b-9ee5-4811-8140-ad815654e92b None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:02.708033 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce71fc1b-9ee5-4811-8140-ad815654e92b None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:02.708309 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce71fc1b-9ee5-4811-8140-ad815654e92b None admin] PATH_INFO: `/v3/domains` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:02.709041 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce71fc1b-9ee5-4811-8140-ad815654e92b None admin] RBAC: Adding query filter params (name=Default) {{(pid=88081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:22:02.709354 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce71fc1b-9ee5-4811-8140-ad815654e92b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:02.710922 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce71fc1b-9ee5-4811-8140-ad815654e92b None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:02.725597 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 279/558] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Sep 24 19:22:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:22:02.726781 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce71fc1b-9ee5-4811-8140-ad815654e92b None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:02.759014 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41742efb-f7e1-4a41-bf75-8f41a18db4ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:02.759666 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41742efb-f7e1-4a41-bf75-8f41a18db4ba None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:02.759942 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41742efb-f7e1-4a41-bf75-8f41a18db4ba None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:02.760755 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41742efb-f7e1-4a41-bf75-8f41a18db4ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:02.773348 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41742efb-f7e1-4a41-bf75-8f41a18db4ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:02.774873 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41742efb-f7e1-4a41-bf75-8f41a18db4ba None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:02.795295 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application [None req-41742efb-f7e1-4a41-bf75-8f41a18db4ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:22:02.795295 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:22:02.795295 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:22:02.795295 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:22:02.795295 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:22:02.795295 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:22:02.795295 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:22:02.795295 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:22:02.795295 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:22:02.795295 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:22:02.795295 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:22:02.795295 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:22:02.795295 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:22:02.795295 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:22:02.795295 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:22:02.795295 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:22:02.796868 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:22:02.796868 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:22:02.796868 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:22:02.796868 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:22:02.796868 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:22:02.796868 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:22:02.796868 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:22:02.796868 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application with Lock( Sep 24 19:22:02.796868 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:22:02.796868 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:22:02.796868 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:22:02.796868 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:22:02.796868 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:22:02.796868 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:22:02.796868 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:22:02.796868 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:22:02.796868 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:22:02.797753 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:22:02.797753 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:22:02.797753 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Sep 24 19:22:02.797753 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 280/559] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Sep 24 19:22:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:22:02.797753 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41742efb-f7e1-4a41-bf75-8f41a18db4ba None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:02.819106 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:22:02.865091 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce71fc1b-9ee5-4811-8140-ad815654e92b None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:02.903172 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2953abb-a7ba-4cbf-af3b-059ec296d2c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:02.903822 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2953abb-a7ba-4cbf-af3b-059ec296d2c0 None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:02.904323 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2953abb-a7ba-4cbf-af3b-059ec296d2c0 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:02.904620 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2953abb-a7ba-4cbf-af3b-059ec296d2c0 None admin] PATH_INFO: `/v3/domains` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:02.905328 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2953abb-a7ba-4cbf-af3b-059ec296d2c0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:22:02.905651 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2953abb-a7ba-4cbf-af3b-059ec296d2c0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:02.907397 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2953abb-a7ba-4cbf-af3b-059ec296d2c0 None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:02.920465 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 280/560] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Sep 24 19:22:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:22:02.922072 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2953abb-a7ba-4cbf-af3b-059ec296d2c0 None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:02.937118 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41742efb-f7e1-4a41-bf75-8f41a18db4ba None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:02.976098 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4d40ca-a9bb-4784-bfd5-b2df23639450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:02.976979 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4d40ca-a9bb-4784-bfd5-b2df23639450 None admin] REQUEST_METHOD: `PUT` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:02.977278 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4d40ca-a9bb-4784-bfd5-b2df23639450 None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:02.979216 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4d40ca-a9bb-4784-bfd5-b2df23639450 None admin] PATH_INFO: `/v3/projects/9dfa5c2c17244006bdd629ec81553f1a/users/cd2db56b901e4fb08a0ec849cc9136f9/roles/0b2e96b9c7cc4c83babfba292ed46c61` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:02.979550 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:22:02.998367 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4d40ca-a9bb-4784-bfd5-b2df23639450 None admin] RBAC: Authorizing `identity:create_grant(project_id=9dfa5c2c17244006bdd629ec81553f1a, user_id=cd2db56b901e4fb08a0ec849cc9136f9, role_id=0b2e96b9c7cc4c83babfba292ed46c61)` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:03.000990 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4d40ca-a9bb-4784-bfd5-b2df23639450 None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:03.015005 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 281/561] 10.222.0.18 () {58 vars in 1439 bytes} [Sat Sep 24 19:22:02 2022] PUT /identity/v3/projects/9dfa5c2c17244006bdd629ec81553f1a/users/cd2db56b901e4fb08a0ec849cc9136f9/roles/0b2e96b9c7cc4c83babfba292ed46c61 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:22:03.016183 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4d40ca-a9bb-4784-bfd5-b2df23639450 None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:03.066246 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2953abb-a7ba-4cbf-af3b-059ec296d2c0 None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:03.107458 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:22:03.116788 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9088fc-79d7-4e64-837c-a91ab90cdbcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:03.117364 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9088fc-79d7-4e64-837c-a91ab90cdbcd None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:03.117655 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9088fc-79d7-4e64-837c-a91ab90cdbcd None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:03.117944 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9088fc-79d7-4e64-837c-a91ab90cdbcd None admin] PATH_INFO: `/v3/users/neutron` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:03.127482 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9088fc-79d7-4e64-837c-a91ab90cdbcd None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:03.128971 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9088fc-79d7-4e64-837c-a91ab90cdbcd None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:03.142623 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application [None req-3e9088fc-79d7-4e64-837c-a91ab90cdbcd None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 24 19:22:03.142623 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:22:03.142623 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:22:03.142623 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:22:03.142623 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:22:03.142623 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:22:03.142623 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:22:03.142623 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:22:03.142623 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:22:03.142623 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:22:03.142623 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:22:03.142623 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:22:03.142623 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 24 19:22:03.142623 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 24 19:22:03.142623 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 24 19:22:03.142623 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 24 19:22:03.143776 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:22:03.143776 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:22:03.143776 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 24 19:22:03.143776 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 19:22:03.143776 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 24 19:22:03.143776 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 19:22:03.143776 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:22:03.143776 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:22:03.143776 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:22:03.143776 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:22:03.143776 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:22:03.143776 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application with Lock( Sep 24 19:22:03.143776 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:22:03.143776 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:22:03.143776 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:22:03.143776 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:22:03.143776 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:22:03.143776 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:22:03.144818 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:22:03.144818 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:22:03.144818 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 24 19:22:03.144818 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 24 19:22:03.144818 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 24 19:22:03.144818 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 24 19:22:03.144818 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 24 19:22:03.144818 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 24 19:22:03.144818 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 24 19:22:03.144818 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Sep 24 19:22:03.144818 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 281/562] 10.222.0.18 () {56 vars in 1102 bytes} [Sat Sep 24 19:22:02 2022] GET /identity/v3/users/neutron => generated 85 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:22:03.144818 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9088fc-79d7-4e64-837c-a91ab90cdbcd None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:03.169362 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4d40ca-a9bb-4784-bfd5-b2df23639450 None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:03.225379 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56361ff7-58d8-42a0-814d-7fcfe8c55360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:03.226513 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56361ff7-58d8-42a0-814d-7fcfe8c55360 None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:03.226776 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56361ff7-58d8-42a0-814d-7fcfe8c55360 None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:03.227231 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56361ff7-58d8-42a0-814d-7fcfe8c55360 None admin] PATH_INFO: `/v3/domains` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:03.228437 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56361ff7-58d8-42a0-814d-7fcfe8c55360 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:22:03.228996 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56361ff7-58d8-42a0-814d-7fcfe8c55360 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:03.231651 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56361ff7-58d8-42a0-814d-7fcfe8c55360 None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:03.253898 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 282/563] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Sep 24 19:22:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:22:03.253898 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56361ff7-58d8-42a0-814d-7fcfe8c55360 None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:03.313371 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9088fc-79d7-4e64-837c-a91ab90cdbcd None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:03.332016 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:22:03.375340 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531f8ff6-e8e9-45a3-82dc-63042e3bb487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:03.375975 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531f8ff6-e8e9-45a3-82dc-63042e3bb487 None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:03.376296 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531f8ff6-e8e9-45a3-82dc-63042e3bb487 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:03.376547 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531f8ff6-e8e9-45a3-82dc-63042e3bb487 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:03.385329 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531f8ff6-e8e9-45a3-82dc-63042e3bb487 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:03.386928 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531f8ff6-e8e9-45a3-82dc-63042e3bb487 None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:03.394588 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56361ff7-58d8-42a0-814d-7fcfe8c55360 None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:03.399825 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application [None req-531f8ff6-e8e9-45a3-82dc-63042e3bb487 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 24 19:22:03.399825 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:22:03.399825 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:22:03.399825 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:22:03.399825 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:22:03.399825 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:22:03.399825 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:22:03.399825 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:22:03.399825 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:22:03.399825 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:22:03.399825 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:22:03.399825 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:22:03.399825 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 24 19:22:03.399825 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 24 19:22:03.399825 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 24 19:22:03.399825 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 24 19:22:03.400943 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:22:03.400943 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:22:03.400943 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 24 19:22:03.400943 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 19:22:03.400943 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 24 19:22:03.400943 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 19:22:03.400943 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:22:03.400943 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:22:03.400943 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:22:03.400943 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:22:03.400943 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:22:03.400943 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application with Lock( Sep 24 19:22:03.400943 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:22:03.400943 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:22:03.400943 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:22:03.400943 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:22:03.400943 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:22:03.400943 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:22:03.402002 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:22:03.402002 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:22:03.402002 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 24 19:22:03.402002 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 24 19:22:03.402002 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 24 19:22:03.402002 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 24 19:22:03.402002 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 24 19:22:03.402002 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 24 19:22:03.402002 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 24 19:22:03.402002 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Sep 24 19:22:03.402002 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 282/564] 10.222.0.18 () {56 vars in 1093 bytes} [Sat Sep 24 19:22:03 2022] GET /identity/v3/users/nova => generated 82 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:22:03.402604 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531f8ff6-e8e9-45a3-82dc-63042e3bb487 None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:03.425557 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:22:03.445913 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec66cbac-badd-4f70-9f7f-2b9c913b9a7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:03.446598 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec66cbac-badd-4f70-9f7f-2b9c913b9a7d None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:03.447028 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec66cbac-badd-4f70-9f7f-2b9c913b9a7d None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:03.447356 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec66cbac-badd-4f70-9f7f-2b9c913b9a7d None admin] PATH_INFO: `/v3/users` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:03.448167 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec66cbac-badd-4f70-9f7f-2b9c913b9a7d None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=88080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:22:03.448583 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec66cbac-badd-4f70-9f7f-2b9c913b9a7d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:03.450784 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec66cbac-badd-4f70-9f7f-2b9c913b9a7d None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:03.485981 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 283/565] 10.222.0.18 () {56 vars in 1139 bytes} [Sat Sep 24 19:22:03 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:22:03.485981 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec66cbac-badd-4f70-9f7f-2b9c913b9a7d None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:03.564562 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531f8ff6-e8e9-45a3-82dc-63042e3bb487 None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:03.614709 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f667958d-1bfc-484c-9626-02b2bec2c00b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:03.615374 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f667958d-1bfc-484c-9626-02b2bec2c00b None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:03.615659 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f667958d-1bfc-484c-9626-02b2bec2c00b None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:03.616249 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f667958d-1bfc-484c-9626-02b2bec2c00b None admin] PATH_INFO: `/v3/users/glance` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:03.619574 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec66cbac-badd-4f70-9f7f-2b9c913b9a7d None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:03.626025 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f667958d-1bfc-484c-9626-02b2bec2c00b None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:03.627507 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f667958d-1bfc-484c-9626-02b2bec2c00b None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:03.643940 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application [None req-f667958d-1bfc-484c-9626-02b2bec2c00b None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 24 19:22:03.643940 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:22:03.643940 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:22:03.643940 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:22:03.643940 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:22:03.643940 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:22:03.643940 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:22:03.643940 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:22:03.643940 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:22:03.643940 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:22:03.643940 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:22:03.643940 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:22:03.643940 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 24 19:22:03.643940 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 24 19:22:03.643940 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 24 19:22:03.643940 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 24 19:22:03.645086 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:22:03.645086 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:22:03.645086 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 24 19:22:03.645086 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 19:22:03.645086 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 24 19:22:03.645086 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 19:22:03.645086 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:22:03.645086 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:22:03.645086 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:22:03.645086 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:22:03.645086 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:22:03.645086 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application with Lock( Sep 24 19:22:03.645086 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:22:03.645086 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:22:03.645086 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:22:03.645086 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:22:03.645086 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:22:03.645086 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:22:03.646742 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:22:03.646742 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:22:03.646742 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 24 19:22:03.646742 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 24 19:22:03.646742 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 24 19:22:03.646742 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 24 19:22:03.646742 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 24 19:22:03.646742 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 24 19:22:03.646742 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 24 19:22:03.646742 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Sep 24 19:22:03.646742 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 283/566] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Sep 24 19:22:03 2022] GET /identity/v3/users/glance => generated 84 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:22:03.646742 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f667958d-1bfc-484c-9626-02b2bec2c00b None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:03.677811 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c1360a-8624-407f-8bcf-57d9909b5009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:03.678620 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c1360a-8624-407f-8bcf-57d9909b5009 None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:03.678732 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c1360a-8624-407f-8bcf-57d9909b5009 None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:03.678979 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c1360a-8624-407f-8bcf-57d9909b5009 None admin] PATH_INFO: `/v3/users` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:03.679713 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c1360a-8624-407f-8bcf-57d9909b5009 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:22:03.680080 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c1360a-8624-407f-8bcf-57d9909b5009 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:03.681501 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c1360a-8624-407f-8bcf-57d9909b5009 None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:03.693338 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:22:03.700948 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 284/567] 10.222.0.18 () {56 vars in 1133 bytes} [Sat Sep 24 19:22:03 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:22:03.703718 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c1360a-8624-407f-8bcf-57d9909b5009 None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:03.745959 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:22:03.789496 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f667958d-1bfc-484c-9626-02b2bec2c00b None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:03.831825 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343528a8-300a-4d6a-b33c-489eaa1be73c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:03.832469 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343528a8-300a-4d6a-b33c-489eaa1be73c None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:03.832749 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343528a8-300a-4d6a-b33c-489eaa1be73c None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:03.833014 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343528a8-300a-4d6a-b33c-489eaa1be73c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:03.840847 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c1360a-8624-407f-8bcf-57d9909b5009 None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:03.846028 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343528a8-300a-4d6a-b33c-489eaa1be73c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:03.847601 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343528a8-300a-4d6a-b33c-489eaa1be73c None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:03.866369 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application [None req-343528a8-300a-4d6a-b33c-489eaa1be73c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:22:03.866369 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:22:03.866369 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:22:03.866369 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:22:03.866369 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:22:03.866369 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:22:03.866369 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:22:03.866369 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:22:03.866369 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:22:03.866369 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:22:03.866369 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:22:03.866369 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:22:03.866369 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:22:03.866369 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:22:03.866369 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:22:03.866369 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:22:03.867724 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:22:03.867724 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:22:03.867724 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:22:03.867724 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:22:03.867724 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:22:03.867724 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:22:03.867724 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:22:03.867724 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application with Lock( Sep 24 19:22:03.867724 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:22:03.867724 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:22:03.867724 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:22:03.867724 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:22:03.867724 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:22:03.867724 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:22:03.867724 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:22:03.867724 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:22:03.867724 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:22:03.874775 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:22:03.874775 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:22:03.874775 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Sep 24 19:22:03.874775 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 284/568] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Sep 24 19:22:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:22:03.874775 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343528a8-300a-4d6a-b33c-489eaa1be73c None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:03.888032 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdcdf06-8c83-48ed-b4af-f8c16409d580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:03.888773 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdcdf06-8c83-48ed-b4af-f8c16409d580 None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:03.889134 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdcdf06-8c83-48ed-b4af-f8c16409d580 None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:03.889516 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdcdf06-8c83-48ed-b4af-f8c16409d580 None admin] PATH_INFO: `/v3/users` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:03.890446 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdcdf06-8c83-48ed-b4af-f8c16409d580 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=88080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:22:03.890834 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdcdf06-8c83-48ed-b4af-f8c16409d580 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:03.892468 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdcdf06-8c83-48ed-b4af-f8c16409d580 None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:03.918808 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 285/569] 10.222.0.18 () {56 vars in 1137 bytes} [Sat Sep 24 19:22:03 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:22:03.919920 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdcdf06-8c83-48ed-b4af-f8c16409d580 None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:03.984328 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:22:04.007934 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343528a8-300a-4d6a-b33c-489eaa1be73c None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:04.041740 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:22:04.050768 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdcdf06-8c83-48ed-b4af-f8c16409d580 None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:04.061878 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150586df-0892-4dcf-b332-229856f580a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:04.062575 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150586df-0892-4dcf-b332-229856f580a4 None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:04.063097 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150586df-0892-4dcf-b332-229856f580a4 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:04.063434 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150586df-0892-4dcf-b332-229856f580a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:04.077510 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150586df-0892-4dcf-b332-229856f580a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:04.079230 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150586df-0892-4dcf-b332-229856f580a4 None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:04.091667 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e489fe-a956-4f23-99c9-96dd3e6da3dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:04.092374 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e489fe-a956-4f23-99c9-96dd3e6da3dc None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:04.093121 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e489fe-a956-4f23-99c9-96dd3e6da3dc None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:04.093462 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e489fe-a956-4f23-99c9-96dd3e6da3dc None admin] PATH_INFO: `/v3/domains` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:04.094187 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e489fe-a956-4f23-99c9-96dd3e6da3dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=88080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:22:04.094564 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e489fe-a956-4f23-99c9-96dd3e6da3dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:04.096084 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e489fe-a956-4f23-99c9-96dd3e6da3dc None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:04.096745 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application [None req-150586df-0892-4dcf-b332-229856f580a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:22:04.096745 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:22:04.096745 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:22:04.096745 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:22:04.096745 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:22:04.096745 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:22:04.096745 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:22:04.096745 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:22:04.096745 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:22:04.096745 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:22:04.096745 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:22:04.096745 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:22:04.096745 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:22:04.096745 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:22:04.096745 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:22:04.096745 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:22:04.097807 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:22:04.097807 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:22:04.097807 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:22:04.097807 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:22:04.097807 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:22:04.097807 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:22:04.097807 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:22:04.097807 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application with Lock( Sep 24 19:22:04.097807 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:22:04.097807 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:22:04.097807 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:22:04.097807 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:22:04.097807 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:22:04.097807 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:22:04.097807 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:22:04.097807 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:22:04.097807 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:22:04.100936 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:22:04.100936 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:22:04.100936 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Sep 24 19:22:04.100936 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 285/570] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Sep 24 19:22:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:22:04.100936 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150586df-0892-4dcf-b332-229856f580a4 None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:04.115564 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 286/571] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Sep 24 19:22:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:22:04.116274 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e489fe-a956-4f23-99c9-96dd3e6da3dc None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:04.249819 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150586df-0892-4dcf-b332-229856f580a4 None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:04.271335 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e489fe-a956-4f23-99c9-96dd3e6da3dc None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:04.294637 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7a71ab-ff66-4356-a713-e05c53f6e670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:04.295304 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7a71ab-ff66-4356-a713-e05c53f6e670 None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:04.295587 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7a71ab-ff66-4356-a713-e05c53f6e670 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:04.295888 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7a71ab-ff66-4356-a713-e05c53f6e670 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:04.299966 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:22:04.311461 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7a71ab-ff66-4356-a713-e05c53f6e670 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:04.313109 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7a71ab-ff66-4356-a713-e05c53f6e670 None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:04.318560 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2114f96b-8aab-4480-8df5-4fdba7975820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:04.319176 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2114f96b-8aab-4480-8df5-4fdba7975820 None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:04.319461 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2114f96b-8aab-4480-8df5-4fdba7975820 None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:04.319736 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2114f96b-8aab-4480-8df5-4fdba7975820 None admin] PATH_INFO: `/v3/domains` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:04.320401 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2114f96b-8aab-4480-8df5-4fdba7975820 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:22:04.320707 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2114f96b-8aab-4480-8df5-4fdba7975820 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:04.322348 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2114f96b-8aab-4480-8df5-4fdba7975820 None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:04.335116 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application [None req-5f7a71ab-ff66-4356-a713-e05c53f6e670 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:22:04.335116 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:22:04.335116 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:22:04.335116 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:22:04.335116 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:22:04.335116 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:22:04.335116 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:22:04.335116 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:22:04.335116 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:22:04.335116 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:22:04.335116 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:22:04.335116 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:22:04.335116 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:22:04.335116 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:22:04.335116 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:22:04.335116 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:22:04.336283 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:22:04.336283 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:22:04.336283 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:22:04.336283 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:22:04.336283 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:22:04.336283 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:22:04.336283 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:22:04.336283 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application with Lock( Sep 24 19:22:04.336283 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:22:04.336283 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:22:04.336283 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:22:04.336283 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:22:04.336283 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:22:04.336283 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:22:04.336283 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:22:04.336283 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:22:04.336283 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:22:04.337794 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:22:04.337794 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:22:04.337794 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Sep 24 19:22:04.337794 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 286/572] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Sep 24 19:22:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:22:04.337794 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7a71ab-ff66-4356-a713-e05c53f6e670 None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:04.342339 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 287/573] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Sep 24 19:22:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:22:04.343212 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2114f96b-8aab-4480-8df5-4fdba7975820 None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:04.361905 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:22:04.466148 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2114f96b-8aab-4480-8df5-4fdba7975820 None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:04.467673 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7a71ab-ff66-4356-a713-e05c53f6e670 None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:04.505576 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a93a7a1-0205-4c93-aa25-0b80a34a0d01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:04.506196 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a93a7a1-0205-4c93-aa25-0b80a34a0d01 None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:04.506464 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a93a7a1-0205-4c93-aa25-0b80a34a0d01 None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:04.506730 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a93a7a1-0205-4c93-aa25-0b80a34a0d01 None admin] PATH_INFO: `/v3/domains` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:04.507372 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a93a7a1-0205-4c93-aa25-0b80a34a0d01 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:22:04.507668 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a93a7a1-0205-4c93-aa25-0b80a34a0d01 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:04.509030 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a93a7a1-0205-4c93-aa25-0b80a34a0d01 None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:04.509130 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ecc38d-7111-4804-9b59-4ea38ef21156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:04.510112 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ecc38d-7111-4804-9b59-4ea38ef21156 None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:04.510834 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ecc38d-7111-4804-9b59-4ea38ef21156 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:04.511182 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ecc38d-7111-4804-9b59-4ea38ef21156 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:04.521977 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 288/574] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Sep 24 19:22:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:22:04.522549 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a93a7a1-0205-4c93-aa25-0b80a34a0d01 None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:04.526928 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ecc38d-7111-4804-9b59-4ea38ef21156 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:04.528393 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ecc38d-7111-4804-9b59-4ea38ef21156 None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:04.545021 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application [None req-e9ecc38d-7111-4804-9b59-4ea38ef21156 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 19:22:04.545021 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:22:04.545021 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:22:04.545021 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:22:04.545021 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:22:04.545021 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:22:04.545021 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:22:04.545021 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:22:04.545021 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:22:04.545021 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:22:04.545021 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:22:04.545021 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:22:04.545021 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 24 19:22:04.545021 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 24 19:22:04.545021 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 24 19:22:04.546079 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 24 19:22:04.546079 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:22:04.546079 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:22:04.546079 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:22:04.546079 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:22:04.546079 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:22:04.546079 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:22:04.546079 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:22:04.546079 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application with Lock( Sep 24 19:22:04.546079 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:22:04.546079 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:22:04.546079 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:22:04.546079 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:22:04.546079 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:22:04.546079 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:22:04.546079 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:22:04.546079 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:22:04.547561 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 24 19:22:04.547561 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 24 19:22:04.547561 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 24 19:22:04.547561 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 24 19:22:04.547561 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 24 19:22:04.547561 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 24 19:22:04.547561 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 19:22:04.547561 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Sep 24 19:22:04.547561 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 287/575] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Sep 24 19:22:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:22:04.547561 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ecc38d-7111-4804-9b59-4ea38ef21156 None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:04.608290 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:22:04.612792 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:22:04.643880 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a93a7a1-0205-4c93-aa25-0b80a34a0d01 None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:04.683442 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bda0b38-0151-439b-89f5-aa4f7b2e672e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:04.684130 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bda0b38-0151-439b-89f5-aa4f7b2e672e None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:04.684405 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bda0b38-0151-439b-89f5-aa4f7b2e672e None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:04.684679 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bda0b38-0151-439b-89f5-aa4f7b2e672e None admin] PATH_INFO: `/v3/projects/service` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:04.684822 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ecc38d-7111-4804-9b59-4ea38ef21156 None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:04.693147 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bda0b38-0151-439b-89f5-aa4f7b2e672e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:04.694887 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bda0b38-0151-439b-89f5-aa4f7b2e672e None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:04.710209 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application [None req-2bda0b38-0151-439b-89f5-aa4f7b2e672e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 19:22:04.710209 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:22:04.710209 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:22:04.710209 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:22:04.710209 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:22:04.710209 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:22:04.710209 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:22:04.710209 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:22:04.710209 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:22:04.710209 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:22:04.710209 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:22:04.710209 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:22:04.710209 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 24 19:22:04.710209 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 24 19:22:04.710209 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 24 19:22:04.711745 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 24 19:22:04.711745 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:22:04.711745 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:22:04.711745 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:22:04.711745 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:22:04.711745 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:22:04.711745 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:22:04.711745 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:22:04.711745 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application with Lock( Sep 24 19:22:04.711745 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:22:04.711745 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:22:04.711745 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:22:04.711745 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:22:04.711745 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:22:04.711745 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:22:04.711745 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:22:04.711745 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:22:04.713254 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 24 19:22:04.713254 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 24 19:22:04.713254 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 24 19:22:04.713254 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 24 19:22:04.713254 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 24 19:22:04.713254 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 24 19:22:04.713254 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 19:22:04.713254 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Sep 24 19:22:04.715523 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 289/576] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Sep 24 19:22:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:22:04.716797 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bda0b38-0151-439b-89f5-aa4f7b2e672e None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:04.733650 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8669ea1f-f226-4fd4-aa4c-dd8dcc1dcd5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:04.734538 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8669ea1f-f226-4fd4-aa4c-dd8dcc1dcd5b None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:04.735000 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8669ea1f-f226-4fd4-aa4c-dd8dcc1dcd5b None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:04.735361 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8669ea1f-f226-4fd4-aa4c-dd8dcc1dcd5b None admin] PATH_INFO: `/v3/projects/service` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:04.745323 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8669ea1f-f226-4fd4-aa4c-dd8dcc1dcd5b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:04.747854 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8669ea1f-f226-4fd4-aa4c-dd8dcc1dcd5b None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:04.761012 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application [None req-8669ea1f-f226-4fd4-aa4c-dd8dcc1dcd5b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 19:22:04.761012 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:22:04.761012 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:22:04.761012 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:22:04.761012 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:22:04.761012 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:22:04.761012 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:22:04.761012 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:22:04.761012 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:22:04.761012 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:22:04.761012 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:22:04.761012 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:22:04.761012 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 24 19:22:04.761012 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 24 19:22:04.761012 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 24 19:22:04.762233 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 24 19:22:04.762233 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:22:04.762233 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:22:04.762233 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:22:04.762233 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:22:04.762233 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:22:04.762233 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:22:04.762233 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:22:04.762233 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application with Lock( Sep 24 19:22:04.762233 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:22:04.762233 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:22:04.762233 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:22:04.762233 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:22:04.762233 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:22:04.762233 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:22:04.762233 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:22:04.762233 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:22:04.763320 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 24 19:22:04.763320 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 24 19:22:04.763320 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 24 19:22:04.763320 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 24 19:22:04.763320 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 24 19:22:04.763320 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 24 19:22:04.763320 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 19:22:04.763320 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Sep 24 19:22:04.763320 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 288/577] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Sep 24 19:22:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:22:04.768141 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8669ea1f-f226-4fd4-aa4c-dd8dcc1dcd5b None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:04.853596 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bda0b38-0151-439b-89f5-aa4f7b2e672e None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:04.891310 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8669ea1f-f226-4fd4-aa4c-dd8dcc1dcd5b None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:04.895651 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fbb44e-379d-4a93-920c-0a270d944240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:04.896261 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fbb44e-379d-4a93-920c-0a270d944240 None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:04.896617 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fbb44e-379d-4a93-920c-0a270d944240 None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:04.896891 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fbb44e-379d-4a93-920c-0a270d944240 None admin] PATH_INFO: `/v3/projects` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:04.897594 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fbb44e-379d-4a93-920c-0a270d944240 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:22:04.898072 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fbb44e-379d-4a93-920c-0a270d944240 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:04.899712 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fbb44e-379d-4a93-920c-0a270d944240 None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:04.900297 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:22:04.902618 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:22:04.922035 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 290/578] 10.222.0.18 () {56 vars in 1148 bytes} [Sat Sep 24 19:22:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:22:04.923877 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fbb44e-379d-4a93-920c-0a270d944240 None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:04.934035 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf948df-6c58-4c71-97cf-d41b9249f2d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:04.935106 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf948df-6c58-4c71-97cf-d41b9249f2d1 None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:04.935592 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf948df-6c58-4c71-97cf-d41b9249f2d1 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:04.936074 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf948df-6c58-4c71-97cf-d41b9249f2d1 None admin] PATH_INFO: `/v3/projects` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:04.937536 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf948df-6c58-4c71-97cf-d41b9249f2d1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:22:04.938373 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf948df-6c58-4c71-97cf-d41b9249f2d1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:04.940002 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf948df-6c58-4c71-97cf-d41b9249f2d1 None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:04.954005 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 289/579] 10.222.0.18 () {56 vars in 1148 bytes} [Sat Sep 24 19:22:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:22:04.955037 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf948df-6c58-4c71-97cf-d41b9249f2d1 None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:05.052978 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fbb44e-379d-4a93-920c-0a270d944240 None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:05.081474 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf948df-6c58-4c71-97cf-d41b9249f2d1 None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:05.095349 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39aaee77-9e72-4ed0-84c5-0044b3c34916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:05.096056 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aaee77-9e72-4ed0-84c5-0044b3c34916 None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:05.096412 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aaee77-9e72-4ed0-84c5-0044b3c34916 None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:05.096869 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aaee77-9e72-4ed0-84c5-0044b3c34916 None admin] PATH_INFO: `/v3/projects` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:05.097820 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39aaee77-9e72-4ed0-84c5-0044b3c34916 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:22:05.098260 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39aaee77-9e72-4ed0-84c5-0044b3c34916 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:05.099915 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39aaee77-9e72-4ed0-84c5-0044b3c34916 None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:05.121166 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 291/580] 10.222.0.18 () {56 vars in 1148 bytes} [Sat Sep 24 19:22:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:22:05.122145 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39aaee77-9e72-4ed0-84c5-0044b3c34916 None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:05.122364 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41de649d-38f6-4b46-9e50-bfcab411e443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:05.123162 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41de649d-38f6-4b46-9e50-bfcab411e443 None admin] REQUEST_METHOD: `PUT` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:05.123569 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41de649d-38f6-4b46-9e50-bfcab411e443 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:05.124633 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41de649d-38f6-4b46-9e50-bfcab411e443 None admin] PATH_INFO: `/v3/projects/9dfa5c2c17244006bdd629ec81553f1a/users/2ef291c173794b49ade9469a5ef72e08/roles/0b2e96b9c7cc4c83babfba292ed46c61` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:05.143657 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41de649d-38f6-4b46-9e50-bfcab411e443 None admin] RBAC: Authorizing `identity:create_grant(project_id=9dfa5c2c17244006bdd629ec81553f1a, user_id=2ef291c173794b49ade9469a5ef72e08, role_id=0b2e96b9c7cc4c83babfba292ed46c61)` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:05.145438 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41de649d-38f6-4b46-9e50-bfcab411e443 None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:05.169977 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 290/581] 10.222.0.18 () {58 vars in 1439 bytes} [Sat Sep 24 19:22:04 2022] PUT /identity/v3/projects/9dfa5c2c17244006bdd629ec81553f1a/users/2ef291c173794b49ade9469a5ef72e08/roles/0b2e96b9c7cc4c83babfba292ed46c61 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:22:05.172315 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41de649d-38f6-4b46-9e50-bfcab411e443 None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:05.192591 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:22:05.210597 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:22:05.275363 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39aaee77-9e72-4ed0-84c5-0044b3c34916 None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:05.315261 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929f62fe-a358-4d27-8a1b-ecec8d8fd0df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:05.316241 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929f62fe-a358-4d27-8a1b-ecec8d8fd0df None admin] REQUEST_METHOD: `PUT` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:05.316670 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929f62fe-a358-4d27-8a1b-ecec8d8fd0df None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:05.317101 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929f62fe-a358-4d27-8a1b-ecec8d8fd0df None admin] PATH_INFO: `/v3/projects/9dfa5c2c17244006bdd629ec81553f1a/users/0ab73abe1c6e4b25a17281f4cd8e97e9/roles/0b2e96b9c7cc4c83babfba292ed46c61` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:05.335875 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929f62fe-a358-4d27-8a1b-ecec8d8fd0df None admin] RBAC: Authorizing `identity:create_grant(project_id=9dfa5c2c17244006bdd629ec81553f1a, user_id=0ab73abe1c6e4b25a17281f4cd8e97e9, role_id=0b2e96b9c7cc4c83babfba292ed46c61)` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:05.337664 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929f62fe-a358-4d27-8a1b-ecec8d8fd0df None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:05.352568 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41de649d-38f6-4b46-9e50-bfcab411e443 None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:05.355971 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 292/582] 10.222.0.18 () {58 vars in 1439 bytes} [Sat Sep 24 19:22:05 2022] PUT /identity/v3/projects/9dfa5c2c17244006bdd629ec81553f1a/users/0ab73abe1c6e4b25a17281f4cd8e97e9/roles/0b2e96b9c7cc4c83babfba292ed46c61 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:22:05.403423 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e1eccc-7eb4-4d8d-82c6-5bbbad7ba1c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:05.404110 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e1eccc-7eb4-4d8d-82c6-5bbbad7ba1c5 None admin] REQUEST_METHOD: `PUT` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:05.404387 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e1eccc-7eb4-4d8d-82c6-5bbbad7ba1c5 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:05.404708 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e1eccc-7eb4-4d8d-82c6-5bbbad7ba1c5 None admin] PATH_INFO: `/v3/projects/9dfa5c2c17244006bdd629ec81553f1a/users/135ee6a2c657412ba6d65a51403ef4d6/roles/0b2e96b9c7cc4c83babfba292ed46c61` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:05.428390 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e1eccc-7eb4-4d8d-82c6-5bbbad7ba1c5 None admin] RBAC: Authorizing `identity:create_grant(project_id=9dfa5c2c17244006bdd629ec81553f1a, user_id=135ee6a2c657412ba6d65a51403ef4d6, role_id=0b2e96b9c7cc4c83babfba292ed46c61)` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:05.430754 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e1eccc-7eb4-4d8d-82c6-5bbbad7ba1c5 None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:05.451340 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 291/583] 10.222.0.18 () {58 vars in 1439 bytes} [Sat Sep 24 19:22:05 2022] PUT /identity/v3/projects/9dfa5c2c17244006bdd629ec81553f1a/users/135ee6a2c657412ba6d65a51403ef4d6/roles/0b2e96b9c7cc4c83babfba292ed46c61 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:22:05.710575 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bc0bd2-debc-4e94-b5ff-bdec7fe5d897 None None] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:05.711098 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bc0bd2-debc-4e94-b5ff-bdec7fe5d897 None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:05.711098 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bc0bd2-debc-4e94-b5ff-bdec7fe5d897 None None] PATH_INFO: `/` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:05.712740 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 293/584] 10.222.0.18 () {54 vars in 927 bytes} [Sat Sep 24 19:22:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:22:05.719391 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89917d53-f055-4461-bd51-7f35f9fd74eb None None] REQUEST_METHOD: `POST` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:05.719937 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89917d53-f055-4461-bd51-7f35f9fd74eb None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:05.719937 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89917d53-f055-4461-bd51-7f35f9fd74eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:05.741097 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.auth.core [None req-89917d53-f055-4461-bd51-7f35f9fd74eb None None] MFA Rules not processed for user `3dbbb9909cec43ff99c1c3682f016ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=88081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:22:05.742462 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.fernet_utils [None req-89917d53-f055-4461-bd51-7f35f9fd74eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:22:05.826214 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:22:05.838155 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 292/585] 10.222.0.18 () {58 vars in 1024 bytes} [Sat Sep 24 19:22:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:22:06.433278 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bc0bd2-debc-4e94-b5ff-bdec7fe5d897 None None] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:06.593681 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bc0bd2-debc-4e94-b5ff-bdec7fe5d897 None None] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:06.596662 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:22:06.637370 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d901f4e-f0c9-4008-a655-6b1725b882c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:06.638064 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d901f4e-f0c9-4008-a655-6b1725b882c8 None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:06.638345 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d901f4e-f0c9-4008-a655-6b1725b882c8 None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:06.638610 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d901f4e-f0c9-4008-a655-6b1725b882c8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:06.651709 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d901f4e-f0c9-4008-a655-6b1725b882c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:22:06.657637 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application [None req-8d901f4e-f0c9-4008-a655-6b1725b882c8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 24 19:22:06.657637 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:22:06.657637 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:22:06.657637 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:22:06.657637 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:22:06.657637 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:22:06.657637 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:22:06.657637 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:22:06.657637 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:22:06.657637 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:22:06.657637 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:22:06.657637 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:22:06.657637 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:22:06.657637 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:22:06.657637 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:22:06.657637 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:22:06.658967 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:22:06.658967 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:22:06.658967 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:22:06.658967 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:22:06.658967 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:22:06.658967 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:22:06.658967 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:22:06.658967 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:22:06.658967 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:22:06.658967 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:22:06.658967 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:22:06.658967 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application with Lock( Sep 24 19:22:06.658967 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:22:06.658967 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:22:06.658967 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:22:06.658967 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:22:06.660636 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:22:06.660636 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:22:06.660636 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:22:06.660636 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:22:06.660636 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:22:06.660636 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:22:06.660636 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:22:06.660636 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:22:06.660636 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:22:06.660636 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:22:06.660636 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 24 19:22:06.660636 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Sep 24 19:22:06.660636 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 294/586] 10.222.0.18 () {56 vars in 1102 bytes} [Sat Sep 24 19:22:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:22:06.664755 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89917d53-f055-4461-bd51-7f35f9fd74eb None None] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:06.778843 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89917d53-f055-4461-bd51-7f35f9fd74eb None None] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:06.816224 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedc6127-5553-42da-a7a8-00564222014b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:06.816868 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedc6127-5553-42da-a7a8-00564222014b None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:06.817217 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedc6127-5553-42da-a7a8-00564222014b None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:06.817492 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedc6127-5553-42da-a7a8-00564222014b None admin] PATH_INFO: `/v3/roles` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:06.818209 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedc6127-5553-42da-a7a8-00564222014b None admin] RBAC: Adding query filter params (name=service) {{(pid=88081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:22:06.818509 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedc6127-5553-42da-a7a8-00564222014b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:06.819893 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedc6127-5553-42da-a7a8-00564222014b None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:06.829969 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 293/587] 10.222.0.18 () {56 vars in 1103 bytes} [Sat Sep 24 19:22:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:22:06.835929 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d901f4e-f0c9-4008-a655-6b1725b882c8 None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:06.965449 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d901f4e-f0c9-4008-a655-6b1725b882c8 None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:07.009109 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97256514-9327-4057-b548-f3559371f9d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:07.009745 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97256514-9327-4057-b548-f3559371f9d7 None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:07.010056 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97256514-9327-4057-b548-f3559371f9d7 None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:07.010322 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97256514-9327-4057-b548-f3559371f9d7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:07.023217 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97256514-9327-4057-b548-f3559371f9d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:07.024608 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97256514-9327-4057-b548-f3559371f9d7 None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:07.040967 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application [None req-97256514-9327-4057-b548-f3559371f9d7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:22:07.040967 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:22:07.040967 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:22:07.040967 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:22:07.040967 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:22:07.040967 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:22:07.040967 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:22:07.040967 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:22:07.040967 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:22:07.040967 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:22:07.040967 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:22:07.040967 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:22:07.040967 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:22:07.040967 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:22:07.040967 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:22:07.040967 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:22:07.042170 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:22:07.042170 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:22:07.042170 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:22:07.042170 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:22:07.042170 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:22:07.042170 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:22:07.042170 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:22:07.042170 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application with Lock( Sep 24 19:22:07.042170 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:22:07.042170 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:22:07.042170 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:22:07.042170 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:22:07.042170 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:22:07.042170 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:22:07.042170 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:22:07.042170 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:22:07.042170 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:22:07.043243 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:22:07.043243 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:22:07.043243 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Sep 24 19:22:07.043243 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 295/588] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Sep 24 19:22:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 19:22:07.049281 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedc6127-5553-42da-a7a8-00564222014b None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:07.139203 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:22:07.196889 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedc6127-5553-42da-a7a8-00564222014b None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:07.242065 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad1e068-72d9-498c-b6ba-803281f69475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:07.242987 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad1e068-72d9-498c-b6ba-803281f69475 None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:07.243467 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad1e068-72d9-498c-b6ba-803281f69475 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:07.243949 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad1e068-72d9-498c-b6ba-803281f69475 None admin] PATH_INFO: `/v3/domains` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:07.245106 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad1e068-72d9-498c-b6ba-803281f69475 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:22:07.245644 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad1e068-72d9-498c-b6ba-803281f69475 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:07.248199 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad1e068-72d9-498c-b6ba-803281f69475 None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:07.271339 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 294/589] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Sep 24 19:22:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:22:07.280620 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97256514-9327-4057-b548-f3559371f9d7 None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:07.314186 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:22:07.424483 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97256514-9327-4057-b548-f3559371f9d7 None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:07.488944 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb336b3-ccf0-4aff-aba0-6eb83101f323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:07.490375 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb336b3-ccf0-4aff-aba0-6eb83101f323 None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:07.490861 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb336b3-ccf0-4aff-aba0-6eb83101f323 None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:07.491333 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb336b3-ccf0-4aff-aba0-6eb83101f323 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:07.506489 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb336b3-ccf0-4aff-aba0-6eb83101f323 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:07.509272 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb336b3-ccf0-4aff-aba0-6eb83101f323 None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:07.531948 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application [None req-4fb336b3-ccf0-4aff-aba0-6eb83101f323 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 24 19:22:07.531948 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:22:07.531948 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:22:07.531948 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:22:07.531948 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:22:07.531948 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:22:07.531948 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:22:07.531948 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:22:07.531948 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:22:07.531948 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:22:07.531948 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:22:07.531948 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:22:07.531948 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 24 19:22:07.531948 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 24 19:22:07.531948 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 24 19:22:07.531948 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 24 19:22:07.532990 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:22:07.532990 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:22:07.532990 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 24 19:22:07.532990 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 19:22:07.532990 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 24 19:22:07.532990 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 19:22:07.532990 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:22:07.532990 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:22:07.532990 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:22:07.532990 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:22:07.532990 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:22:07.532990 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application with Lock( Sep 24 19:22:07.532990 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:22:07.532990 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:22:07.532990 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:22:07.532990 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:22:07.532990 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:22:07.532990 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:22:07.534151 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:22:07.534151 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:22:07.534151 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 24 19:22:07.534151 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 24 19:22:07.534151 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 24 19:22:07.534151 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 24 19:22:07.534151 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 24 19:22:07.534151 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 24 19:22:07.534151 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 24 19:22:07.534151 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Sep 24 19:22:07.534689 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 296/590] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Sep 24 19:22:07 2022] GET /identity/v3/users/cinder => generated 84 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:22:07.539686 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad1e068-72d9-498c-b6ba-803281f69475 None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:07.694657 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad1e068-72d9-498c-b6ba-803281f69475 None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:07.718194 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:22:07.737192 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d3137e-7ffb-421c-bc42-4529a6c3a549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:07.738248 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d3137e-7ffb-421c-bc42-4529a6c3a549 None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:07.738526 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d3137e-7ffb-421c-bc42-4529a6c3a549 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:07.738792 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d3137e-7ffb-421c-bc42-4529a6c3a549 None admin] PATH_INFO: `/v3/users` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:07.739772 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d3137e-7ffb-421c-bc42-4529a6c3a549 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=88081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:22:07.740069 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d3137e-7ffb-421c-bc42-4529a6c3a549 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:07.741506 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d3137e-7ffb-421c-bc42-4529a6c3a549 None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:07.761256 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 295/591] 10.222.0.18 () {56 vars in 1137 bytes} [Sat Sep 24 19:22:07 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:22:07.767065 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb336b3-ccf0-4aff-aba0-6eb83101f323 None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:07.857969 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:22:07.890250 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb336b3-ccf0-4aff-aba0-6eb83101f323 None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:07.928773 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7512d95-dbb8-4f2a-9260-3555585068f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:07.929377 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7512d95-dbb8-4f2a-9260-3555585068f5 None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:07.929649 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7512d95-dbb8-4f2a-9260-3555585068f5 None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:07.929943 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7512d95-dbb8-4f2a-9260-3555585068f5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:07.976632 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bed6e0-b82b-45b5-994a-0eab8d507742 None None] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:07.977153 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bed6e0-b82b-45b5-994a-0eab8d507742 None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:07.977264 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bed6e0-b82b-45b5-994a-0eab8d507742 None None] PATH_INFO: `/` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:07.979054 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 296/592] 10.222.0.18 () {54 vars in 927 bytes} [Sat Sep 24 19:22:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:22:07.986571 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb32642d-329e-4311-a517-76d1c218bed3 None None] REQUEST_METHOD: `POST` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:07.986908 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb32642d-329e-4311-a517-76d1c218bed3 None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:07.987111 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb32642d-329e-4311-a517-76d1c218bed3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:08.011441 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.auth.core [None req-eb32642d-329e-4311-a517-76d1c218bed3 None None] MFA Rules not processed for user `3dbbb9909cec43ff99c1c3682f016ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=88081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:22:08.012663 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.fernet_utils [None req-eb32642d-329e-4311-a517-76d1c218bed3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:22:08.058344 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7512d95-dbb8-4f2a-9260-3555585068f5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:08.059748 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7512d95-dbb8-4f2a-9260-3555585068f5 None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:08.101174 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 297/593] 10.222.0.18 () {58 vars in 1024 bytes} [Sat Sep 24 19:22:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 24 19:22:08.102574 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb40000-84aa-4841-8ab7-4f2989760dc9 None None] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:08.102889 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb40000-84aa-4841-8ab7-4f2989760dc9 None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:08.103184 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb40000-84aa-4841-8ab7-4f2989760dc9 None None] PATH_INFO: `/` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:08.104668 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 298/594] 10.222.0.18 () {54 vars in 927 bytes} [Sat Sep 24 19:22:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:22:08.114859 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28046c28-f0eb-46f6-a688-72e5bf697386 None None] REQUEST_METHOD: `POST` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:08.114859 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28046c28-f0eb-46f6-a688-72e5bf697386 None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:08.114859 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28046c28-f0eb-46f6-a688-72e5bf697386 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:08.140525 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.auth.core [None req-28046c28-f0eb-46f6-a688-72e5bf697386 None None] MFA Rules not processed for user `3dbbb9909cec43ff99c1c3682f016ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=88081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:22:08.142620 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.fernet_utils [None req-28046c28-f0eb-46f6-a688-72e5bf697386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:22:08.162705 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:22:08.195207 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 297/595] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Sep 24 19:22:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 24 19:22:08.204459 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7512d95-dbb8-4f2a-9260-3555585068f5 None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:08.237076 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 299/596] 10.222.0.18 () {58 vars in 1024 bytes} [Sat Sep 24 19:22:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 24 19:22:08.240709 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb15f5fc-4928-48d4-a9f2-f301d091bc3a None None] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:08.241027 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb15f5fc-4928-48d4-a9f2-f301d091bc3a None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:08.241307 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb15f5fc-4928-48d4-a9f2-f301d091bc3a None None] PATH_INFO: `/` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:08.243106 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 300/597] 10.222.0.18 () {54 vars in 927 bytes} [Sat Sep 24 19:22:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 24 19:22:08.248650 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb46d7a5-58e7-40c1-8532-8da03d5f0057 None None] REQUEST_METHOD: `POST` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:08.248930 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb46d7a5-58e7-40c1-8532-8da03d5f0057 None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:08.249203 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb46d7a5-58e7-40c1-8532-8da03d5f0057 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:08.269313 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.auth.core [None req-bb46d7a5-58e7-40c1-8532-8da03d5f0057 None None] MFA Rules not processed for user `3dbbb9909cec43ff99c1c3682f016ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=88081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:22:08.270797 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.fernet_utils [None req-bb46d7a5-58e7-40c1-8532-8da03d5f0057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:22:08.312067 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:22:08.360986 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 301/598] 10.222.0.18 () {58 vars in 1024 bytes} [Sat Sep 24 19:22:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:22:08.369600 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7512d95-dbb8-4f2a-9260-3555585068f5 None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:08.413572 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0767f1-de42-45c4-b464-62589f5a488d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:08.414247 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0767f1-de42-45c4-b464-62589f5a488d None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:08.414527 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0767f1-de42-45c4-b464-62589f5a488d None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:08.414797 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0767f1-de42-45c4-b464-62589f5a488d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:08.425946 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0767f1-de42-45c4-b464-62589f5a488d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:08.427549 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0767f1-de42-45c4-b464-62589f5a488d None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:08.444018 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application [None req-ba0767f1-de42-45c4-b464-62589f5a488d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:22:08.444018 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:22:08.444018 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:22:08.444018 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:22:08.444018 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:22:08.444018 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:22:08.444018 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:22:08.444018 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:22:08.444018 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:22:08.444018 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:22:08.444018 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:22:08.444018 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:22:08.444018 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:22:08.444018 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:22:08.444018 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:22:08.444018 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:22:08.445004 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:22:08.445004 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:22:08.445004 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:22:08.445004 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:22:08.445004 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:22:08.445004 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:22:08.445004 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:22:08.445004 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application with Lock( Sep 24 19:22:08.445004 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:22:08.445004 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:22:08.445004 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:22:08.445004 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:22:08.445004 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:22:08.445004 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:22:08.445004 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:22:08.445004 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:22:08.445004 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:22:08.446012 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:22:08.446012 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:22:08.446012 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Sep 24 19:22:08.446012 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 298/599] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Sep 24 19:22:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:22:08.452595 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb46d7a5-58e7-40c1-8532-8da03d5f0057 None None] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:08.516699 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0767f1-de42-45c4-b464-62589f5a488d None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:08.555017 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:22:08.592596 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb46d7a5-58e7-40c1-8532-8da03d5f0057 None None] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:08.639907 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f169d77-28a2-409e-b1b4-26c8dba6f2fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:08.640750 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f169d77-28a2-409e-b1b4-26c8dba6f2fe None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:08.641079 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f169d77-28a2-409e-b1b4-26c8dba6f2fe None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:08.641442 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f169d77-28a2-409e-b1b4-26c8dba6f2fe None admin] PATH_INFO: `/v3/domains` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:08.642541 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f169d77-28a2-409e-b1b4-26c8dba6f2fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=88081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:22:08.642883 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f169d77-28a2-409e-b1b4-26c8dba6f2fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:08.644557 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f169d77-28a2-409e-b1b4-26c8dba6f2fe None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:08.654998 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0767f1-de42-45c4-b464-62589f5a488d None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:08.663152 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 302/600] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Sep 24 19:22:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:22:08.663152 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f169d77-28a2-409e-b1b4-26c8dba6f2fe None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:08.699794 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:22:08.704822 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d05c377-e73b-4999-924d-30b82fddd04a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:08.705436 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d05c377-e73b-4999-924d-30b82fddd04a None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:08.705717 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d05c377-e73b-4999-924d-30b82fddd04a None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:08.706049 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d05c377-e73b-4999-924d-30b82fddd04a None admin] PATH_INFO: `/v3/roles/service` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:08.717033 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d05c377-e73b-4999-924d-30b82fddd04a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:22:08.723420 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application [None req-5d05c377-e73b-4999-924d-30b82fddd04a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 24 19:22:08.723420 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:22:08.723420 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:22:08.723420 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:22:08.723420 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:22:08.723420 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:22:08.723420 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:22:08.723420 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:22:08.723420 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:22:08.723420 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:22:08.723420 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:22:08.723420 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:22:08.723420 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:22:08.723420 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:22:08.723420 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:22:08.723420 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:22:08.724865 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:22:08.724865 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:22:08.724865 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:22:08.724865 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:22:08.724865 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:22:08.724865 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:22:08.724865 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:22:08.724865 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:22:08.724865 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:22:08.724865 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:22:08.724865 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:22:08.724865 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application with Lock( Sep 24 19:22:08.724865 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:22:08.724865 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:22:08.724865 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:22:08.724865 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:22:08.727185 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:22:08.727185 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:22:08.727185 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:22:08.727185 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:22:08.727185 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:22:08.727185 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:22:08.727185 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:22:08.727185 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:22:08.727185 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:22:08.727185 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:22:08.727185 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 24 19:22:08.727185 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Sep 24 19:22:08.727185 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 299/601] 10.222.0.18 () {56 vars in 1102 bytes} [Sat Sep 24 19:22:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:22:08.727185 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d05c377-e73b-4999-924d-30b82fddd04a None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:08.821415 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f169d77-28a2-409e-b1b4-26c8dba6f2fe None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:08.824899 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:22:08.842927 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d05c377-e73b-4999-924d-30b82fddd04a None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:08.859528 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcc0ee6-c042-4158-ab4b-ef16d766fa94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:08.860162 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcc0ee6-c042-4158-ab4b-ef16d766fa94 None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:08.860454 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcc0ee6-c042-4158-ab4b-ef16d766fa94 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:08.860714 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcc0ee6-c042-4158-ab4b-ef16d766fa94 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:08.877509 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcc0ee6-c042-4158-ab4b-ef16d766fa94 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:22:08.881773 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2eb89a8-f55d-4a33-bdf2-de11d842a6b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:08.882428 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eb89a8-f55d-4a33-bdf2-de11d842a6b1 None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:08.882702 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eb89a8-f55d-4a33-bdf2-de11d842a6b1 None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:08.882971 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eb89a8-f55d-4a33-bdf2-de11d842a6b1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:08.890702 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2eb89a8-f55d-4a33-bdf2-de11d842a6b1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:08.891905 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application [None req-bdcc0ee6-c042-4158-ab4b-ef16d766fa94 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 24 19:22:08.891905 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:22:08.891905 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:22:08.891905 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:22:08.891905 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:22:08.891905 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:22:08.891905 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:22:08.891905 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:22:08.891905 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:22:08.891905 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:22:08.891905 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:22:08.891905 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:22:08.891905 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:22:08.891905 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:22:08.891905 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:22:08.891905 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:22:08.893187 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:22:08.893187 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:22:08.893187 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:22:08.893187 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:22:08.893187 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:22:08.893187 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:22:08.893187 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:22:08.893187 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:22:08.893187 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:22:08.893187 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:22:08.893187 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:22:08.893187 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application with Lock( Sep 24 19:22:08.893187 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:22:08.893187 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:22:08.893187 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:22:08.893187 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:22:08.894366 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:22:08.894366 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:22:08.894366 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:22:08.894366 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:22:08.894366 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:22:08.894366 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:22:08.894366 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:22:08.894366 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:22:08.894366 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:22:08.894366 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:22:08.894366 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 24 19:22:08.894366 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Sep 24 19:22:08.895662 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2eb89a8-f55d-4a33-bdf2-de11d842a6b1 None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:08.895810 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 303/602] 10.222.0.18 () {56 vars in 1102 bytes} [Sat Sep 24 19:22:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:22:08.895810 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcc0ee6-c042-4158-ab4b-ef16d766fa94 None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:08.908555 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application [None req-f2eb89a8-f55d-4a33-bdf2-de11d842a6b1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 19:22:08.908555 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:22:08.908555 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:22:08.908555 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:22:08.908555 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:22:08.908555 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:22:08.908555 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:22:08.908555 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:22:08.908555 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:22:08.908555 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:22:08.908555 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:22:08.908555 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:22:08.908555 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 24 19:22:08.908555 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 24 19:22:08.908555 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 24 19:22:08.909532 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 24 19:22:08.909532 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:22:08.909532 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:22:08.909532 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:22:08.909532 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:22:08.909532 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:22:08.909532 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:22:08.909532 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:22:08.909532 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application with Lock( Sep 24 19:22:08.909532 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:22:08.909532 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:22:08.909532 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:22:08.909532 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:22:08.909532 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:22:08.909532 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:22:08.909532 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:22:08.909532 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:22:08.910566 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 24 19:22:08.910566 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 24 19:22:08.910566 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 24 19:22:08.910566 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 24 19:22:08.910566 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 24 19:22:08.910566 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 24 19:22:08.910566 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 19:22:08.910566 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Sep 24 19:22:08.910566 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 300/603] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Sep 24 19:22:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:22:08.911086 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2eb89a8-f55d-4a33-bdf2-de11d842a6b1 None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:08.996909 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:22:09.016308 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcc0ee6-c042-4158-ab4b-ef16d766fa94 None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:09.049743 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2eb89a8-f55d-4a33-bdf2-de11d842a6b1 None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:09.066852 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb684ba-6a21-4ea4-9022-17d1698a7739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:09.067749 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb684ba-6a21-4ea4-9022-17d1698a7739 None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:09.068449 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb684ba-6a21-4ea4-9022-17d1698a7739 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:09.068863 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb684ba-6a21-4ea4-9022-17d1698a7739 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:09.087756 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb684ba-6a21-4ea4-9022-17d1698a7739 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:22:09.095182 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application [None req-6fb684ba-6a21-4ea4-9022-17d1698a7739 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 24 19:22:09.095182 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:22:09.095182 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:22:09.095182 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:22:09.095182 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:22:09.095182 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:22:09.095182 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:22:09.095182 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:22:09.095182 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:22:09.095182 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:22:09.095182 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:22:09.095182 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:22:09.095182 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:22:09.095182 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:22:09.095182 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:22:09.095182 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:22:09.096267 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:22:09.096267 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:22:09.096267 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:22:09.096267 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:22:09.096267 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:22:09.096267 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:22:09.096267 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:22:09.096267 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:22:09.096267 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:22:09.096267 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:22:09.096267 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:22:09.096267 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application with Lock( Sep 24 19:22:09.096267 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:22:09.096267 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:22:09.096267 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:22:09.096267 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:22:09.097580 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:22:09.097580 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:22:09.097580 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:22:09.097580 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:22:09.097580 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:22:09.097580 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:22:09.097580 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:22:09.097580 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:22:09.097580 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:22:09.097580 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:22:09.097580 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 24 19:22:09.097580 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Sep 24 19:22:09.097580 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 304/604] 10.222.0.18 () {56 vars in 1102 bytes} [Sat Sep 24 19:22:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:22:09.099183 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb684ba-6a21-4ea4-9022-17d1698a7739 None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:09.102007 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641ca768-bffa-4256-adc5-c0aebc12a793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:09.102803 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641ca768-bffa-4256-adc5-c0aebc12a793 None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:09.103267 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641ca768-bffa-4256-adc5-c0aebc12a793 None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:09.103702 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641ca768-bffa-4256-adc5-c0aebc12a793 None admin] PATH_INFO: `/v3/roles` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:09.104626 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641ca768-bffa-4256-adc5-c0aebc12a793 None admin] RBAC: Adding query filter params (name=service) {{(pid=88080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:22:09.105063 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641ca768-bffa-4256-adc5-c0aebc12a793 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:09.106760 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641ca768-bffa-4256-adc5-c0aebc12a793 None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:09.117496 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 301/605] 10.222.0.18 () {56 vars in 1103 bytes} [Sat Sep 24 19:22:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:22:09.118477 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641ca768-bffa-4256-adc5-c0aebc12a793 None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:09.133374 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:22:09.234603 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb684ba-6a21-4ea4-9022-17d1698a7739 None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:09.239461 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641ca768-bffa-4256-adc5-c0aebc12a793 None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:09.280999 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0d4fc2-1371-47ab-8faf-c05114277c51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:09.281762 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0d4fc2-1371-47ab-8faf-c05114277c51 None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:09.282203 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0d4fc2-1371-47ab-8faf-c05114277c51 None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:09.282575 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0d4fc2-1371-47ab-8faf-c05114277c51 None admin] PATH_INFO: `/v3/projects` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:09.283403 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0d4fc2-1371-47ab-8faf-c05114277c51 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:22:09.283860 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0d4fc2-1371-47ab-8faf-c05114277c51 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:09.285454 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41c8aa2-171a-4e07-b2b4-847ed0399d82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:09.285619 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0d4fc2-1371-47ab-8faf-c05114277c51 None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:09.286182 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41c8aa2-171a-4e07-b2b4-847ed0399d82 None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:09.286464 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41c8aa2-171a-4e07-b2b4-847ed0399d82 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:09.286739 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41c8aa2-171a-4e07-b2b4-847ed0399d82 None admin] PATH_INFO: `/v3/roles` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:09.287439 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41c8aa2-171a-4e07-b2b4-847ed0399d82 None admin] RBAC: Adding query filter params (name=service) {{(pid=88081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:22:09.287764 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41c8aa2-171a-4e07-b2b4-847ed0399d82 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:09.289257 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41c8aa2-171a-4e07-b2b4-847ed0399d82 None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:09.303855 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 305/606] 10.222.0.18 () {56 vars in 1103 bytes} [Sat Sep 24 19:22:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:22:09.304133 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 302/607] 10.222.0.18 () {56 vars in 1148 bytes} [Sat Sep 24 19:22:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:22:09.304295 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41c8aa2-171a-4e07-b2b4-847ed0399d82 None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:09.304444 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0d4fc2-1371-47ab-8faf-c05114277c51 None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:09.318761 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:22:09.387134 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:22:09.421312 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41c8aa2-171a-4e07-b2b4-847ed0399d82 None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:09.428523 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0d4fc2-1371-47ab-8faf-c05114277c51 None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:09.460476 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca429cf-6a2a-409c-a8d0-ccbd17956223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:09.461070 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca429cf-6a2a-409c-a8d0-ccbd17956223 None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:09.461344 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca429cf-6a2a-409c-a8d0-ccbd17956223 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:09.461611 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca429cf-6a2a-409c-a8d0-ccbd17956223 None admin] PATH_INFO: `/v3/roles` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:09.462305 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca429cf-6a2a-409c-a8d0-ccbd17956223 None admin] RBAC: Adding query filter params (name=service) {{(pid=88081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:22:09.462606 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca429cf-6a2a-409c-a8d0-ccbd17956223 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:09.464021 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca429cf-6a2a-409c-a8d0-ccbd17956223 None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:09.472225 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e9f85a-98d8-4dcb-9328-196b98ef08d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:09.473007 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e9f85a-98d8-4dcb-9328-196b98ef08d8 None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:09.473255 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e9f85a-98d8-4dcb-9328-196b98ef08d8 None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:09.473557 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e9f85a-98d8-4dcb-9328-196b98ef08d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:09.473646 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 306/608] 10.222.0.18 () {56 vars in 1103 bytes} [Sat Sep 24 19:22:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:22:09.474465 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca429cf-6a2a-409c-a8d0-ccbd17956223 None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:09.485216 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e9f85a-98d8-4dcb-9328-196b98ef08d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:09.486579 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e9f85a-98d8-4dcb-9328-196b98ef08d8 None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:09.503899 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application [None req-56e9f85a-98d8-4dcb-9328-196b98ef08d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:22:09.503899 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:22:09.503899 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:22:09.503899 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:22:09.503899 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:22:09.503899 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:22:09.503899 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:22:09.503899 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:22:09.503899 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:22:09.503899 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:22:09.503899 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:22:09.503899 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:22:09.503899 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:22:09.503899 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:22:09.503899 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:22:09.503899 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:22:09.504932 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:22:09.504932 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:22:09.504932 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:22:09.504932 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:22:09.504932 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:22:09.504932 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:22:09.504932 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:22:09.504932 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application with Lock( Sep 24 19:22:09.504932 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:22:09.504932 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:22:09.504932 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:22:09.504932 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:22:09.504932 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:22:09.504932 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:22:09.504932 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:22:09.504932 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:22:09.504932 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:22:09.505876 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:22:09.505876 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:22:09.505876 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Sep 24 19:22:09.505876 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 303/609] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Sep 24 19:22:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:22:09.505876 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e9f85a-98d8-4dcb-9328-196b98ef08d8 None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:09.557993 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:22:09.600707 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca429cf-6a2a-409c-a8d0-ccbd17956223 None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:09.621854 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e9f85a-98d8-4dcb-9328-196b98ef08d8 None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:09.645431 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65142e22-42be-4159-a2ed-d594bf78e59d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:09.646478 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65142e22-42be-4159-a2ed-d594bf78e59d None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:09.646865 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65142e22-42be-4159-a2ed-d594bf78e59d None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:09.647199 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65142e22-42be-4159-a2ed-d594bf78e59d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:09.647653 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:22:09.661618 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb44340-c7e8-4dd6-abcb-e4169f38e08f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:09.662258 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb44340-c7e8-4dd6-abcb-e4169f38e08f None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:09.662527 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb44340-c7e8-4dd6-abcb-e4169f38e08f None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:09.662794 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb44340-c7e8-4dd6-abcb-e4169f38e08f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:09.663525 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb44340-c7e8-4dd6-abcb-e4169f38e08f None admin] RBAC: Adding query filter params (role.id=0b2e96b9c7cc4c83babfba292ed46c61, scope.project.id=9dfa5c2c17244006bdd629ec81553f1a, user.id=cd2db56b901e4fb08a0ec849cc9136f9) {{(pid=88080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:22:09.663823 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb44340-c7e8-4dd6-abcb-e4169f38e08f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:09.665270 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb44340-c7e8-4dd6-abcb-e4169f38e08f None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:09.666713 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65142e22-42be-4159-a2ed-d594bf78e59d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:09.668171 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65142e22-42be-4159-a2ed-d594bf78e59d None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:09.672264 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 304/610] 10.222.0.18 () {56 vars in 1374 bytes} [Sat Sep 24 19:22:09 2022] GET /identity/v3/role_assignments?user.id=cd2db56b901e4fb08a0ec849cc9136f9&scope.project.id=9dfa5c2c17244006bdd629ec81553f1a&role.id=0b2e96b9c7cc4c83babfba292ed46c61 => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:22:09.673092 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb44340-c7e8-4dd6-abcb-e4169f38e08f None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:09.684786 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application [None req-65142e22-42be-4159-a2ed-d594bf78e59d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:22:09.684786 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:22:09.684786 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:22:09.684786 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:22:09.684786 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:22:09.684786 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:22:09.684786 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:22:09.684786 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:22:09.684786 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:22:09.684786 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:22:09.684786 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:22:09.684786 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:22:09.684786 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:22:09.684786 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:22:09.684786 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:22:09.684786 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:22:09.686509 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:22:09.686509 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:22:09.686509 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:22:09.686509 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:22:09.686509 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:22:09.686509 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:22:09.686509 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:22:09.686509 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application with Lock( Sep 24 19:22:09.686509 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:22:09.686509 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:22:09.686509 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:22:09.686509 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:22:09.686509 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:22:09.686509 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:22:09.686509 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:22:09.686509 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:22:09.686509 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:22:09.687739 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:22:09.687739 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:22:09.687739 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Sep 24 19:22:09.687739 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 307/611] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Sep 24 19:22:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:22:09.687739 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65142e22-42be-4159-a2ed-d594bf78e59d None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:09.810993 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb44340-c7e8-4dd6-abcb-e4169f38e08f None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:09.838179 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65142e22-42be-4159-a2ed-d594bf78e59d None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:09.865720 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbbd026-c6bb-4229-983f-12e702d1d6ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:09.866814 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbbd026-c6bb-4229-983f-12e702d1d6ae None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:09.867299 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbbd026-c6bb-4229-983f-12e702d1d6ae None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:09.867770 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbbd026-c6bb-4229-983f-12e702d1d6ae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:09.868386 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:22:09.882386 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710b4f24-462c-44f9-afa5-04295f0b46c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:09.883004 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710b4f24-462c-44f9-afa5-04295f0b46c6 None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:09.883740 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710b4f24-462c-44f9-afa5-04295f0b46c6 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:09.883740 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710b4f24-462c-44f9-afa5-04295f0b46c6 None admin] PATH_INFO: `/v3/domains` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:09.884183 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710b4f24-462c-44f9-afa5-04295f0b46c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:22:09.884481 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710b4f24-462c-44f9-afa5-04295f0b46c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:09.885895 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710b4f24-462c-44f9-afa5-04295f0b46c6 None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:09.890893 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbbd026-c6bb-4229-983f-12e702d1d6ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:09.892820 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbbd026-c6bb-4229-983f-12e702d1d6ae None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:09.910489 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 308/612] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Sep 24 19:22:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:22:09.910489 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710b4f24-462c-44f9-afa5-04295f0b46c6 None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:09.915430 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application [None req-5cbbd026-c6bb-4229-983f-12e702d1d6ae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:22:09.915430 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:22:09.915430 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:22:09.915430 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:22:09.915430 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:22:09.915430 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:22:09.915430 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:22:09.915430 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:22:09.915430 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:22:09.915430 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:22:09.915430 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:22:09.915430 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:22:09.915430 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:22:09.915430 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:22:09.915430 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:22:09.915430 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:22:09.916385 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:22:09.916385 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:22:09.916385 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:22:09.916385 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:22:09.916385 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:22:09.916385 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:22:09.916385 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:22:09.916385 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application with Lock( Sep 24 19:22:09.916385 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:22:09.916385 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:22:09.916385 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:22:09.916385 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:22:09.916385 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:22:09.916385 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:22:09.916385 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:22:09.916385 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:22:09.916385 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:22:09.917255 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:22:09.917255 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:22:09.917255 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Sep 24 19:22:09.917421 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 305/613] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Sep 24 19:22:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:22:09.920559 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbbd026-c6bb-4229-983f-12e702d1d6ae None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:09.977166 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:22:10.044059 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710b4f24-462c-44f9-afa5-04295f0b46c6 None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:10.070117 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbbd026-c6bb-4229-983f-12e702d1d6ae None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:10.082932 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4aaf9a-4082-4acd-a627-f984ea775c02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:10.083612 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4aaf9a-4082-4acd-a627-f984ea775c02 None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:10.083895 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4aaf9a-4082-4acd-a627-f984ea775c02 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:10.084187 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4aaf9a-4082-4acd-a627-f984ea775c02 None admin] PATH_INFO: `/v3/domains` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:10.084862 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4aaf9a-4082-4acd-a627-f984ea775c02 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:22:10.085133 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4aaf9a-4082-4acd-a627-f984ea775c02 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:10.086541 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4aaf9a-4082-4acd-a627-f984ea775c02 None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:10.100386 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 309/614] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Sep 24 19:22:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:22:10.101520 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4aaf9a-4082-4acd-a627-f984ea775c02 None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:10.127698 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c6966f-30a0-4d16-a6d2-3a7c28d63429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:10.128151 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c6966f-30a0-4d16-a6d2-3a7c28d63429 None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:10.128429 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c6966f-30a0-4d16-a6d2-3a7c28d63429 None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:10.128699 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c6966f-30a0-4d16-a6d2-3a7c28d63429 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:10.137146 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c6966f-30a0-4d16-a6d2-3a7c28d63429 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:10.139267 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c6966f-30a0-4d16-a6d2-3a7c28d63429 None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:10.156683 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application [None req-59c6966f-30a0-4d16-a6d2-3a7c28d63429 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 24 19:22:10.156683 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:22:10.156683 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:22:10.156683 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:22:10.156683 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:22:10.156683 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:22:10.156683 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:22:10.156683 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:22:10.156683 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:22:10.156683 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:22:10.156683 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:22:10.156683 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:22:10.156683 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 24 19:22:10.156683 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 24 19:22:10.156683 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 24 19:22:10.156683 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 24 19:22:10.158248 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:22:10.158248 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:22:10.158248 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 24 19:22:10.158248 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 19:22:10.158248 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 24 19:22:10.158248 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 19:22:10.158248 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:22:10.158248 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:22:10.158248 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:22:10.158248 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:22:10.158248 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:22:10.158248 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application with Lock( Sep 24 19:22:10.158248 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:22:10.158248 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:22:10.158248 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:22:10.158248 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:22:10.158248 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:22:10.158248 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:22:10.159923 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:22:10.159923 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:22:10.159923 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 24 19:22:10.159923 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 24 19:22:10.159923 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 24 19:22:10.159923 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 24 19:22:10.159923 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 24 19:22:10.159923 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 24 19:22:10.159923 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 24 19:22:10.159923 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Sep 24 19:22:10.159923 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 306/615] 10.222.0.18 () {56 vars in 1102 bytes} [Sat Sep 24 19:22:09 2022] GET /identity/v3/users/neutron => generated 85 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:22:10.159923 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c6966f-30a0-4d16-a6d2-3a7c28d63429 None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:10.162195 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:22:10.239525 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4aaf9a-4082-4acd-a627-f984ea775c02 None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:10.286696 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:22:10.288462 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5899b8d-00b4-421b-bb04-1b0931e8eae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:10.289568 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5899b8d-00b4-421b-bb04-1b0931e8eae1 None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:10.290166 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5899b8d-00b4-421b-bb04-1b0931e8eae1 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:10.290838 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5899b8d-00b4-421b-bb04-1b0931e8eae1 None admin] PATH_INFO: `/v3/domains` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:10.291193 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c6966f-30a0-4d16-a6d2-3a7c28d63429 None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:10.292251 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5899b8d-00b4-421b-bb04-1b0931e8eae1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:22:10.292791 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5899b8d-00b4-421b-bb04-1b0931e8eae1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:10.296474 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5899b8d-00b4-421b-bb04-1b0931e8eae1 None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:10.310721 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 310/616] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Sep 24 19:22:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:22:10.311959 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5899b8d-00b4-421b-bb04-1b0931e8eae1 None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:10.345952 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb3ccd9-0c2f-4b02-b5a4-0885774d4270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:10.346881 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb3ccd9-0c2f-4b02-b5a4-0885774d4270 None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:10.347481 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb3ccd9-0c2f-4b02-b5a4-0885774d4270 None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:10.347943 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb3ccd9-0c2f-4b02-b5a4-0885774d4270 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:10.360859 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb3ccd9-0c2f-4b02-b5a4-0885774d4270 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:10.362621 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb3ccd9-0c2f-4b02-b5a4-0885774d4270 None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:10.381329 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application [None req-1eb3ccd9-0c2f-4b02-b5a4-0885774d4270 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 24 19:22:10.381329 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:22:10.381329 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:22:10.381329 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:22:10.381329 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:22:10.381329 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:22:10.381329 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:22:10.381329 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:22:10.381329 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:22:10.381329 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:22:10.381329 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:22:10.381329 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:22:10.381329 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 24 19:22:10.381329 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 24 19:22:10.381329 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 24 19:22:10.381329 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 24 19:22:10.382392 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:22:10.382392 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:22:10.382392 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 24 19:22:10.382392 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 19:22:10.382392 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 24 19:22:10.382392 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 19:22:10.382392 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:22:10.382392 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:22:10.382392 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:22:10.382392 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:22:10.382392 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:22:10.382392 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application with Lock( Sep 24 19:22:10.382392 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:22:10.382392 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:22:10.382392 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:22:10.382392 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:22:10.382392 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:22:10.382392 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:22:10.383309 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:22:10.383309 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:22:10.383309 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 24 19:22:10.383309 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 24 19:22:10.383309 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 24 19:22:10.383309 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 24 19:22:10.383309 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 24 19:22:10.383309 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 24 19:22:10.383309 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 24 19:22:10.383309 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Sep 24 19:22:10.383309 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 307/617] 10.222.0.18 () {56 vars in 1093 bytes} [Sat Sep 24 19:22:10 2022] GET /identity/v3/users/nova => generated 82 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:22:10.384389 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb3ccd9-0c2f-4b02-b5a4-0885774d4270 None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:10.444992 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5899b8d-00b4-421b-bb04-1b0931e8eae1 None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:10.448284 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:22:10.499025 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2deab261-995d-42fe-ae62-e9e75232c679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:10.499650 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deab261-995d-42fe-ae62-e9e75232c679 None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:10.499924 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deab261-995d-42fe-ae62-e9e75232c679 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:10.500194 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deab261-995d-42fe-ae62-e9e75232c679 None admin] PATH_INFO: `/v3/users` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:10.501413 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2deab261-995d-42fe-ae62-e9e75232c679 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=88081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:22:10.501727 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2deab261-995d-42fe-ae62-e9e75232c679 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:10.503620 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2deab261-995d-42fe-ae62-e9e75232c679 None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:10.518870 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb3ccd9-0c2f-4b02-b5a4-0885774d4270 None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:10.524922 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 311/618] 10.222.0.18 () {56 vars in 1139 bytes} [Sat Sep 24 19:22:10 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:22:10.525974 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2deab261-995d-42fe-ae62-e9e75232c679 None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:10.571256 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40bfedf-91ef-4c52-95a4-2a1152c9acec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:10.571783 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40bfedf-91ef-4c52-95a4-2a1152c9acec None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:10.572074 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40bfedf-91ef-4c52-95a4-2a1152c9acec None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:10.572333 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40bfedf-91ef-4c52-95a4-2a1152c9acec None admin] PATH_INFO: `/v3/users/glance` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:10.584006 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40bfedf-91ef-4c52-95a4-2a1152c9acec None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:10.586252 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40bfedf-91ef-4c52-95a4-2a1152c9acec None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:10.600529 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application [None req-f40bfedf-91ef-4c52-95a4-2a1152c9acec None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 24 19:22:10.600529 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:22:10.600529 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:22:10.600529 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:22:10.600529 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:22:10.600529 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:22:10.600529 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:22:10.600529 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:22:10.600529 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:22:10.600529 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:22:10.600529 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:22:10.600529 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:22:10.600529 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 24 19:22:10.600529 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 24 19:22:10.600529 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 24 19:22:10.600529 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 24 19:22:10.601715 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:22:10.601715 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:22:10.601715 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 24 19:22:10.601715 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 19:22:10.601715 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 24 19:22:10.601715 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 19:22:10.601715 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:22:10.601715 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:22:10.601715 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:22:10.601715 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:22:10.601715 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:22:10.601715 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application with Lock( Sep 24 19:22:10.601715 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:22:10.601715 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:22:10.601715 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:22:10.601715 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:22:10.601715 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:22:10.601715 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:22:10.602875 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:22:10.602875 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:22:10.602875 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 24 19:22:10.602875 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 24 19:22:10.602875 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 24 19:22:10.602875 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 24 19:22:10.602875 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 24 19:22:10.602875 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 24 19:22:10.602875 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 24 19:22:10.602875 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Sep 24 19:22:10.602875 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 308/619] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Sep 24 19:22:10 2022] GET /identity/v3/users/glance => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:22:10.602875 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40bfedf-91ef-4c52-95a4-2a1152c9acec None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:10.632281 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:22:10.656903 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2deab261-995d-42fe-ae62-e9e75232c679 None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:10.702964 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0198e3e-f358-45a2-99b3-60a0b3a8c9cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:10.703876 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0198e3e-f358-45a2-99b3-60a0b3a8c9cb None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:10.704642 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0198e3e-f358-45a2-99b3-60a0b3a8c9cb None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:10.705883 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0198e3e-f358-45a2-99b3-60a0b3a8c9cb None admin] PATH_INFO: `/v3/users` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:10.706819 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0198e3e-f358-45a2-99b3-60a0b3a8c9cb None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:22:10.707127 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0198e3e-f358-45a2-99b3-60a0b3a8c9cb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:10.708608 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0198e3e-f358-45a2-99b3-60a0b3a8c9cb None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:10.736270 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 312/620] 10.222.0.18 () {56 vars in 1133 bytes} [Sat Sep 24 19:22:10 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:22:10.736270 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0198e3e-f358-45a2-99b3-60a0b3a8c9cb None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:10.763678 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40bfedf-91ef-4c52-95a4-2a1152c9acec None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:10.764588 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:22:10.815833 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d9bab0-31f8-4224-889d-661238a42b0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:10.816580 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d9bab0-31f8-4224-889d-661238a42b0d None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:10.816922 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d9bab0-31f8-4224-889d-661238a42b0d None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:10.817264 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d9bab0-31f8-4224-889d-661238a42b0d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:10.865332 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0198e3e-f358-45a2-99b3-60a0b3a8c9cb None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:10.910902 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097fd05a-29a6-49c3-80c8-b110064c0c6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:10.911666 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097fd05a-29a6-49c3-80c8-b110064c0c6b None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:10.912640 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097fd05a-29a6-49c3-80c8-b110064c0c6b None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:10.912995 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097fd05a-29a6-49c3-80c8-b110064c0c6b None admin] PATH_INFO: `/v3/users` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:10.914688 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097fd05a-29a6-49c3-80c8-b110064c0c6b None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=88081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:22:10.915013 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097fd05a-29a6-49c3-80c8-b110064c0c6b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:10.917018 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097fd05a-29a6-49c3-80c8-b110064c0c6b None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:10.921157 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d9bab0-31f8-4224-889d-661238a42b0d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:10.923188 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d9bab0-31f8-4224-889d-661238a42b0d None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:10.941871 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 313/621] 10.222.0.18 () {56 vars in 1137 bytes} [Sat Sep 24 19:22:10 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:22:10.942654 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097fd05a-29a6-49c3-80c8-b110064c0c6b None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:10.960447 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:22:11.071247 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:22:11.117374 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 309/622] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Sep 24 19:22:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 507 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 24 19:22:11.117374 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d9bab0-31f8-4224-889d-661238a42b0d None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:11.122416 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097fd05a-29a6-49c3-80c8-b110064c0c6b None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:11.167971 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a33ccac-0390-490c-8f0c-a9e23a478dd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:11.168872 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a33ccac-0390-490c-8f0c-a9e23a478dd2 None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:11.169226 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a33ccac-0390-490c-8f0c-a9e23a478dd2 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:11.169619 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a33ccac-0390-490c-8f0c-a9e23a478dd2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:11.235222 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d9bab0-31f8-4224-889d-661238a42b0d None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:11.262628 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:22:11.287679 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420cce73-d7e5-4567-b940-a55800be0a8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:11.288425 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420cce73-d7e5-4567-b940-a55800be0a8e None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:11.288798 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420cce73-d7e5-4567-b940-a55800be0a8e None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:11.289178 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420cce73-d7e5-4567-b940-a55800be0a8e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:11.293590 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a33ccac-0390-490c-8f0c-a9e23a478dd2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:11.295745 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a33ccac-0390-490c-8f0c-a9e23a478dd2 None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:11.386055 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420cce73-d7e5-4567-b940-a55800be0a8e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:11.387425 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420cce73-d7e5-4567-b940-a55800be0a8e None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:11.392617 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:22:11.424379 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 314/623] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Sep 24 19:22:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 482 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 24 19:22:11.431110 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a33ccac-0390-490c-8f0c-a9e23a478dd2 None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:11.517269 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 310/624] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Sep 24 19:22:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 24 19:22:11.518196 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420cce73-d7e5-4567-b940-a55800be0a8e None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:11.539308 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:22:11.584734 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a33ccac-0390-490c-8f0c-a9e23a478dd2 None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:11.630652 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd78400-5bf2-491b-89e2-1068805eaf51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:11.631291 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd78400-5bf2-491b-89e2-1068805eaf51 None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:11.631567 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd78400-5bf2-491b-89e2-1068805eaf51 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:11.631836 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd78400-5bf2-491b-89e2-1068805eaf51 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:11.643999 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd78400-5bf2-491b-89e2-1068805eaf51 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:11.645413 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd78400-5bf2-491b-89e2-1068805eaf51 None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:11.646048 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420cce73-d7e5-4567-b940-a55800be0a8e None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:11.662801 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application [None req-bdd78400-5bf2-491b-89e2-1068805eaf51 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:22:11.662801 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:22:11.662801 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:22:11.662801 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:22:11.662801 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:22:11.662801 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:22:11.662801 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:22:11.662801 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:22:11.662801 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:22:11.662801 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:22:11.662801 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:22:11.662801 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:22:11.662801 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:22:11.662801 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:22:11.662801 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:22:11.662801 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:22:11.663801 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:22:11.663801 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:22:11.663801 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:22:11.663801 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:22:11.663801 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:22:11.663801 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:22:11.663801 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:22:11.663801 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application with Lock( Sep 24 19:22:11.663801 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:22:11.663801 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:22:11.663801 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:22:11.663801 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:22:11.663801 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:22:11.663801 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:22:11.663801 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:22:11.663801 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:22:11.663801 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:22:11.664721 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:22:11.664721 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:22:11.664721 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Sep 24 19:22:11.664721 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 315/625] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Sep 24 19:22:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:22:11.664945 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd78400-5bf2-491b-89e2-1068805eaf51 None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:11.699770 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ceeb919-103e-414b-ac7b-c0982316c81d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:11.700864 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceeb919-103e-414b-ac7b-c0982316c81d None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:11.701924 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceeb919-103e-414b-ac7b-c0982316c81d None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:11.702388 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceeb919-103e-414b-ac7b-c0982316c81d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:11.708129 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:22:11.716219 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ceeb919-103e-414b-ac7b-c0982316c81d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:11.718557 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ceeb919-103e-414b-ac7b-c0982316c81d None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:11.736552 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application [None req-7ceeb919-103e-414b-ac7b-c0982316c81d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:22:11.736552 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:22:11.736552 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:22:11.736552 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:22:11.736552 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:22:11.736552 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:22:11.736552 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:22:11.736552 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:22:11.736552 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:22:11.736552 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:22:11.736552 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:22:11.736552 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:22:11.736552 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:22:11.736552 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:22:11.736552 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:22:11.736552 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:22:11.737732 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:22:11.737732 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:22:11.737732 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:22:11.737732 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:22:11.737732 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:22:11.737732 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:22:11.737732 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:22:11.737732 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application with Lock( Sep 24 19:22:11.737732 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:22:11.737732 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:22:11.737732 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:22:11.737732 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:22:11.737732 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:22:11.737732 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:22:11.737732 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:22:11.737732 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:22:11.737732 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:22:11.738825 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:22:11.738825 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:22:11.738825 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Sep 24 19:22:11.745173 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 311/626] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Sep 24 19:22:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:22:11.746143 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ceeb919-103e-414b-ac7b-c0982316c81d None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:11.809506 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd78400-5bf2-491b-89e2-1068805eaf51 None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:11.841945 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:22:11.852607 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3667e1a-8bda-4bb2-9004-7e74d42e6d29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:11.853237 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3667e1a-8bda-4bb2-9004-7e74d42e6d29 None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:11.853511 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3667e1a-8bda-4bb2-9004-7e74d42e6d29 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:11.853775 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3667e1a-8bda-4bb2-9004-7e74d42e6d29 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:11.866296 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3667e1a-8bda-4bb2-9004-7e74d42e6d29 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:11.868238 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3667e1a-8bda-4bb2-9004-7e74d42e6d29 None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:11.880640 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ceeb919-103e-414b-ac7b-c0982316c81d None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:11.887791 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application [None req-e3667e1a-8bda-4bb2-9004-7e74d42e6d29 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:22:11.887791 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:22:11.887791 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:22:11.887791 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:22:11.887791 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:22:11.887791 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:22:11.887791 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:22:11.887791 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:22:11.887791 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:22:11.887791 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:22:11.887791 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:22:11.887791 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:22:11.887791 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:22:11.887791 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:22:11.887791 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:22:11.887791 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:22:11.888829 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:22:11.888829 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:22:11.888829 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:22:11.888829 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:22:11.888829 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:22:11.888829 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:22:11.888829 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:22:11.888829 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application with Lock( Sep 24 19:22:11.888829 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:22:11.888829 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:22:11.888829 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:22:11.888829 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:22:11.888829 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:22:11.888829 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:22:11.888829 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:22:11.888829 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:22:11.888829 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:22:11.889741 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:22:11.889741 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:22:11.889741 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Sep 24 19:22:11.893655 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 316/627] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Sep 24 19:22:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:22:11.894759 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3667e1a-8bda-4bb2-9004-7e74d42e6d29 None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:11.925604 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8e0212-92d4-4a1a-b44c-9038936134b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:11.926403 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8e0212-92d4-4a1a-b44c-9038936134b3 None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:11.926536 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8e0212-92d4-4a1a-b44c-9038936134b3 None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:11.926787 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8e0212-92d4-4a1a-b44c-9038936134b3 None admin] PATH_INFO: `/v3/domains` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:11.927548 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8e0212-92d4-4a1a-b44c-9038936134b3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:22:11.927725 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8e0212-92d4-4a1a-b44c-9038936134b3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:11.929076 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8e0212-92d4-4a1a-b44c-9038936134b3 None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:11.944597 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 312/628] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Sep 24 19:22:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:22:11.946547 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8e0212-92d4-4a1a-b44c-9038936134b3 None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:11.998714 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:22:12.027146 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3667e1a-8bda-4bb2-9004-7e74d42e6d29 None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:12.071956 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9984222-dd08-4fac-a033-18de8464a121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:12.072600 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9984222-dd08-4fac-a033-18de8464a121 None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:12.072973 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9984222-dd08-4fac-a033-18de8464a121 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:12.073333 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9984222-dd08-4fac-a033-18de8464a121 None admin] PATH_INFO: `/v3/domains` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:12.073932 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9984222-dd08-4fac-a033-18de8464a121 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:22:12.074231 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9984222-dd08-4fac-a033-18de8464a121 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:12.075378 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8e0212-92d4-4a1a-b44c-9038936134b3 None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:12.075658 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9984222-dd08-4fac-a033-18de8464a121 None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:12.100707 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 317/629] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Sep 24 19:22:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:22:12.102305 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9984222-dd08-4fac-a033-18de8464a121 None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:12.110743 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:22:12.117659 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa21ff2-3347-4d77-90fb-80eb5722caec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:12.118340 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa21ff2-3347-4d77-90fb-80eb5722caec None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:12.118640 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa21ff2-3347-4d77-90fb-80eb5722caec None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:12.118883 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa21ff2-3347-4d77-90fb-80eb5722caec None admin] PATH_INFO: `/v3/domains` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:12.119532 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa21ff2-3347-4d77-90fb-80eb5722caec None admin] RBAC: Adding query filter params (name=Default) {{(pid=88080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:22:12.119831 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa21ff2-3347-4d77-90fb-80eb5722caec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:12.121224 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa21ff2-3347-4d77-90fb-80eb5722caec None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:12.134402 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 313/630] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Sep 24 19:22:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:22:12.135173 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa21ff2-3347-4d77-90fb-80eb5722caec None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:12.237788 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9984222-dd08-4fac-a033-18de8464a121 None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:12.274950 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b749e987-30d2-45ba-b814-4d6cdea35403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:12.275577 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b749e987-30d2-45ba-b814-4d6cdea35403 None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:12.275853 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b749e987-30d2-45ba-b814-4d6cdea35403 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:12.276123 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b749e987-30d2-45ba-b814-4d6cdea35403 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:12.280995 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa21ff2-3347-4d77-90fb-80eb5722caec None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:12.283648 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b749e987-30d2-45ba-b814-4d6cdea35403 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:12.285095 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b749e987-30d2-45ba-b814-4d6cdea35403 None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:12.287907 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:22:12.297896 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application [None req-b749e987-30d2-45ba-b814-4d6cdea35403 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 19:22:12.297896 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:22:12.297896 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:22:12.297896 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:22:12.297896 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:22:12.297896 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:22:12.297896 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:22:12.297896 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:22:12.297896 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:22:12.297896 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:22:12.297896 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:22:12.297896 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:22:12.297896 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 24 19:22:12.297896 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 24 19:22:12.297896 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 24 19:22:12.299004 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 24 19:22:12.299004 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:22:12.299004 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:22:12.299004 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:22:12.299004 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:22:12.299004 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:22:12.299004 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:22:12.299004 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:22:12.299004 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application with Lock( Sep 24 19:22:12.299004 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:22:12.299004 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:22:12.299004 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:22:12.299004 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:22:12.299004 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:22:12.299004 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:22:12.299004 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:22:12.299004 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:22:12.300899 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 24 19:22:12.300899 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 24 19:22:12.300899 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 24 19:22:12.300899 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 24 19:22:12.300899 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 24 19:22:12.300899 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 24 19:22:12.300899 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 19:22:12.300899 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Sep 24 19:22:12.300899 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 318/631] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Sep 24 19:22:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:22:12.300899 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b749e987-30d2-45ba-b814-4d6cdea35403 None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:12.326453 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e862dc-202d-4e6a-8db1-4e899651ed4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:12.327416 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e862dc-202d-4e6a-8db1-4e899651ed4b None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:12.327855 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e862dc-202d-4e6a-8db1-4e899651ed4b None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:12.328293 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e862dc-202d-4e6a-8db1-4e899651ed4b None admin] PATH_INFO: `/v3/projects/service` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:12.336558 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e862dc-202d-4e6a-8db1-4e899651ed4b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:12.338029 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e862dc-202d-4e6a-8db1-4e899651ed4b None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:12.350155 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application [None req-e7e862dc-202d-4e6a-8db1-4e899651ed4b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 19:22:12.350155 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:22:12.350155 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:22:12.350155 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:22:12.350155 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:22:12.350155 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:22:12.350155 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:22:12.350155 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:22:12.350155 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:22:12.350155 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:22:12.350155 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:22:12.350155 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:22:12.350155 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 24 19:22:12.350155 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 24 19:22:12.350155 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 24 19:22:12.351970 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 24 19:22:12.351970 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:22:12.351970 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:22:12.351970 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:22:12.351970 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:22:12.351970 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:22:12.351970 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:22:12.351970 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:22:12.351970 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application with Lock( Sep 24 19:22:12.351970 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:22:12.351970 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:22:12.351970 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:22:12.351970 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:22:12.351970 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:22:12.351970 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:22:12.351970 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:22:12.351970 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:22:12.353802 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 24 19:22:12.353802 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 24 19:22:12.353802 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 24 19:22:12.353802 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 24 19:22:12.353802 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 24 19:22:12.353802 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 24 19:22:12.353802 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 19:22:12.353802 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Sep 24 19:22:12.356047 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 314/632] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Sep 24 19:22:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:22:12.357350 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21953e75-81f5-4e61-bc65-d000f378c2a6 None None] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:12.357701 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21953e75-81f5-4e61-bc65-d000f378c2a6 None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:12.358001 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21953e75-81f5-4e61-bc65-d000f378c2a6 None None] PATH_INFO: `/` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:12.359476 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 315/633] 10.222.0.18 () {54 vars in 927 bytes} [Sat Sep 24 19:22:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:22:12.360046 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21953e75-81f5-4e61-bc65-d000f378c2a6 None None] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:12.420583 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:22:12.436294 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b749e987-30d2-45ba-b814-4d6cdea35403 None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:12.475564 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4aaf5c-6ae3-4a68-b24c-9b7825b41bb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:12.476527 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4aaf5c-6ae3-4a68-b24c-9b7825b41bb7 None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:12.476941 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4aaf5c-6ae3-4a68-b24c-9b7825b41bb7 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:12.477205 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4aaf5c-6ae3-4a68-b24c-9b7825b41bb7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:12.483440 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21953e75-81f5-4e61-bc65-d000f378c2a6 None None] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:12.495262 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4aaf5c-6ae3-4a68-b24c-9b7825b41bb7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:12.496646 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4aaf5c-6ae3-4a68-b24c-9b7825b41bb7 None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:12.510067 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application [None req-1a4aaf5c-6ae3-4a68-b24c-9b7825b41bb7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 19:22:12.510067 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:22:12.510067 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:22:12.510067 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:22:12.510067 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:22:12.510067 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:22:12.510067 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:22:12.510067 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:22:12.510067 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:22:12.510067 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:22:12.510067 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:22:12.510067 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:22:12.510067 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 24 19:22:12.510067 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 24 19:22:12.510067 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 24 19:22:12.511032 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 24 19:22:12.511032 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:22:12.511032 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:22:12.511032 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:22:12.511032 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:22:12.511032 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:22:12.511032 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:22:12.511032 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:22:12.511032 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application with Lock( Sep 24 19:22:12.511032 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:22:12.511032 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:22:12.511032 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:22:12.511032 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:22:12.511032 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:22:12.511032 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:22:12.511032 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:22:12.511032 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:22:12.512168 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 24 19:22:12.512168 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 24 19:22:12.512168 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 24 19:22:12.512168 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 24 19:22:12.512168 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 24 19:22:12.512168 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 24 19:22:12.512168 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 19:22:12.512168 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Sep 24 19:22:12.512168 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 319/634] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Sep 24 19:22:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:22:12.512168 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4aaf5c-6ae3-4a68-b24c-9b7825b41bb7 None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:12.527607 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c949a42-1534-4a2f-8483-3dfbdb818e7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:12.528611 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c949a42-1534-4a2f-8483-3dfbdb818e7b None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:12.528611 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c949a42-1534-4a2f-8483-3dfbdb818e7b None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:12.528816 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c949a42-1534-4a2f-8483-3dfbdb818e7b None admin] PATH_INFO: `/v3/projects` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:12.529435 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c949a42-1534-4a2f-8483-3dfbdb818e7b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:22:12.529721 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c949a42-1534-4a2f-8483-3dfbdb818e7b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:12.531182 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c949a42-1534-4a2f-8483-3dfbdb818e7b None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:12.543206 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 316/635] 10.222.0.18 () {56 vars in 1148 bytes} [Sat Sep 24 19:22:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:22:12.544327 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f6d735-7e39-40db-9250-987f352afb12 None None] REQUEST_METHOD: `POST` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:12.544607 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f6d735-7e39-40db-9250-987f352afb12 None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:12.544880 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f6d735-7e39-40db-9250-987f352afb12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:12.567096 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.auth.core [None req-99f6d735-7e39-40db-9250-987f352afb12 None None] MFA Rules not processed for user `3dbbb9909cec43ff99c1c3682f016ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=88080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:22:12.567306 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.fernet_utils [None req-99f6d735-7e39-40db-9250-987f352afb12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:22:12.595304 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:22:12.643770 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4aaf5c-6ae3-4a68-b24c-9b7825b41bb7 None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:12.651176 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 317/636] 10.222.0.18 () {58 vars in 1024 bytes} [Sat Sep 24 19:22:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:22:12.652040 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f6d735-7e39-40db-9250-987f352afb12 None None] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:12.695146 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2da5c3-c7ec-424e-bff1-32b2493a8639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:12.696128 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2da5c3-c7ec-424e-bff1-32b2493a8639 None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:12.696465 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2da5c3-c7ec-424e-bff1-32b2493a8639 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:12.696826 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2da5c3-c7ec-424e-bff1-32b2493a8639 None admin] PATH_INFO: `/v3/projects` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:12.698602 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2da5c3-c7ec-424e-bff1-32b2493a8639 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:22:12.700066 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2da5c3-c7ec-424e-bff1-32b2493a8639 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:12.701726 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2da5c3-c7ec-424e-bff1-32b2493a8639 None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:12.721340 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 320/637] 10.222.0.18 () {56 vars in 1148 bytes} [Sat Sep 24 19:22:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:22:12.722307 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2da5c3-c7ec-424e-bff1-32b2493a8639 None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:12.744120 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:22:12.842758 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f6d735-7e39-40db-9250-987f352afb12 None None] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:12.865606 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2da5c3-c7ec-424e-bff1-32b2493a8639 None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:12.899596 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:22:12.908672 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6a9675-ee99-4ae5-85e7-791473252c10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:12.909739 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6a9675-ee99-4ae5-85e7-791473252c10 None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:12.910692 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6a9675-ee99-4ae5-85e7-791473252c10 None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:12.911363 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6a9675-ee99-4ae5-85e7-791473252c10 None admin] PATH_INFO: `/v3/projects` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:12.912487 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6a9675-ee99-4ae5-85e7-791473252c10 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:22:12.912822 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6a9675-ee99-4ae5-85e7-791473252c10 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:12.914724 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6a9675-ee99-4ae5-85e7-791473252c10 None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:12.920801 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c23440-56d0-4cfe-8d11-3084b61ab0f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:12.921419 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c23440-56d0-4cfe-8d11-3084b61ab0f9 None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:12.921698 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c23440-56d0-4cfe-8d11-3084b61ab0f9 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:12.922004 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c23440-56d0-4cfe-8d11-3084b61ab0f9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:12.922735 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c23440-56d0-4cfe-8d11-3084b61ab0f9 None admin] RBAC: Adding query filter params (role.id=0b2e96b9c7cc4c83babfba292ed46c61, scope.project.id=9dfa5c2c17244006bdd629ec81553f1a, user.id=2ef291c173794b49ade9469a5ef72e08) {{(pid=88081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:22:12.923056 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c23440-56d0-4cfe-8d11-3084b61ab0f9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:12.924475 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c23440-56d0-4cfe-8d11-3084b61ab0f9 None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:12.932869 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 321/638] 10.222.0.18 () {56 vars in 1374 bytes} [Sat Sep 24 19:22:12 2022] GET /identity/v3/role_assignments?user.id=2ef291c173794b49ade9469a5ef72e08&scope.project.id=9dfa5c2c17244006bdd629ec81553f1a&role.id=0b2e96b9c7cc4c83babfba292ed46c61 => generated 608 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:22:12.934133 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c23440-56d0-4cfe-8d11-3084b61ab0f9 None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:12.940647 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 318/639] 10.222.0.18 () {56 vars in 1148 bytes} [Sat Sep 24 19:22:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:22:12.945419 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6a9675-ee99-4ae5-85e7-791473252c10 None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:13.091642 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c23440-56d0-4cfe-8d11-3084b61ab0f9 None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:13.096937 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:22:13.100440 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6a9675-ee99-4ae5-85e7-791473252c10 None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:13.144839 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f148d5-6a8b-4c43-bcd8-ab0fceb833a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:13.146054 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f148d5-6a8b-4c43-bcd8-ab0fceb833a4 None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:13.146403 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f148d5-6a8b-4c43-bcd8-ab0fceb833a4 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:13.146824 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f148d5-6a8b-4c43-bcd8-ab0fceb833a4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:13.148085 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f148d5-6a8b-4c43-bcd8-ab0fceb833a4 None admin] RBAC: Adding query filter params (role.id=0b2e96b9c7cc4c83babfba292ed46c61, scope.project.id=9dfa5c2c17244006bdd629ec81553f1a, user.id=0ab73abe1c6e4b25a17281f4cd8e97e9) {{(pid=88081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:22:13.148651 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f148d5-6a8b-4c43-bcd8-ab0fceb833a4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:13.150927 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f148d5-6a8b-4c43-bcd8-ab0fceb833a4 None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:13.156790 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cec2dfe-6dab-4740-bd18-dd8a2b53fb1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:13.157481 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cec2dfe-6dab-4740-bd18-dd8a2b53fb1f None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:13.157948 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cec2dfe-6dab-4740-bd18-dd8a2b53fb1f None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:13.158675 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cec2dfe-6dab-4740-bd18-dd8a2b53fb1f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:13.160038 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cec2dfe-6dab-4740-bd18-dd8a2b53fb1f None admin] RBAC: Adding query filter params (role.id=0b2e96b9c7cc4c83babfba292ed46c61, scope.project.id=9dfa5c2c17244006bdd629ec81553f1a, user.id=135ee6a2c657412ba6d65a51403ef4d6) {{(pid=88080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:22:13.160581 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cec2dfe-6dab-4740-bd18-dd8a2b53fb1f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:13.162174 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 322/640] 10.222.0.18 () {56 vars in 1374 bytes} [Sat Sep 24 19:22:12 2022] GET /identity/v3/role_assignments?user.id=0ab73abe1c6e4b25a17281f4cd8e97e9&scope.project.id=9dfa5c2c17244006bdd629ec81553f1a&role.id=0b2e96b9c7cc4c83babfba292ed46c61 => generated 608 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:22:13.163435 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f148d5-6a8b-4c43-bcd8-ab0fceb833a4 None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:13.174409 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cec2dfe-6dab-4740-bd18-dd8a2b53fb1f None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:13.183073 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 319/641] 10.222.0.18 () {56 vars in 1374 bytes} [Sat Sep 24 19:22:12 2022] GET /identity/v3/role_assignments?user.id=135ee6a2c657412ba6d65a51403ef4d6&scope.project.id=9dfa5c2c17244006bdd629ec81553f1a&role.id=0b2e96b9c7cc4c83babfba292ed46c61 => generated 608 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:22:13.258156 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:22:13.346347 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f148d5-6a8b-4c43-bcd8-ab0fceb833a4 None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:13.390864 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d529712-08cd-41b0-af76-da71aaf07c50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:13.391934 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d529712-08cd-41b0-af76-da71aaf07c50 None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:13.392417 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d529712-08cd-41b0-af76-da71aaf07c50 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:13.392894 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d529712-08cd-41b0-af76-da71aaf07c50 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:13.393756 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d529712-08cd-41b0-af76-da71aaf07c50 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:13.395534 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d529712-08cd-41b0-af76-da71aaf07c50 None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:13.409223 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application [None req-8d529712-08cd-41b0-af76-da71aaf07c50 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 24 19:22:13.409223 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:22:13.409223 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 24 19:22:13.409223 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 24 19:22:13.409223 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 24 19:22:13.409223 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 24 19:22:13.409223 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 24 19:22:13.409223 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 19:22:13.409223 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 24 19:22:13.409223 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Sep 24 19:22:13.409223 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 24 19:22:13.409223 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Sep 24 19:22:13.409223 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:22:13.409223 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:22:13.409223 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:22:13.409223 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:22:13.409223 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:22:13.410406 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:22:13.410406 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:22:13.410406 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:22:13.410406 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:22:13.410406 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:22:13.410406 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:22:13.410406 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 24 19:22:13.410406 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 24 19:22:13.410406 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 24 19:22:13.410406 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 24 19:22:13.410406 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:22:13.410406 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:22:13.410406 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:22:13.410406 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:22:13.410406 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:22:13.410406 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:22:13.411324 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:22:13.411324 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application with Lock( Sep 24 19:22:13.411324 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:22:13.411324 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:22:13.411324 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:22:13.411324 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:22:13.411324 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:22:13.411324 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:22:13.411324 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:22:13.411324 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:22:13.411324 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 24 19:22:13.411324 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 19:22:13.411324 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 24 19:22:13.411324 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Sep 24 19:22:13.414117 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 323/642] 10.222.0.18 () {56 vars in 1129 bytes} [Sat Sep 24 19:22:13 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:22:13.423972 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cec2dfe-6dab-4740-bd18-dd8a2b53fb1f None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:13.590732 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cec2dfe-6dab-4740-bd18-dd8a2b53fb1f None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:13.634528 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da73083-a86d-47d6-a9ba-4f09965439cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:13.635609 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da73083-a86d-47d6-a9ba-4f09965439cd None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:13.636161 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da73083-a86d-47d6-a9ba-4f09965439cd None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:13.636639 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da73083-a86d-47d6-a9ba-4f09965439cd None admin] PATH_INFO: `/v3/services` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:13.637701 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da73083-a86d-47d6-a9ba-4f09965439cd None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=88080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:22:13.638319 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da73083-a86d-47d6-a9ba-4f09965439cd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:13.640145 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da73083-a86d-47d6-a9ba-4f09965439cd None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:13.646352 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 320/643] 10.222.0.18 () {56 vars in 1124 bytes} [Sat Sep 24 19:22:13 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:22:13.653655 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d529712-08cd-41b0-af76-da71aaf07c50 None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:13.800058 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d529712-08cd-41b0-af76-da71aaf07c50 None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:13.817275 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:22:13.842417 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15189f8a-24ac-4a74-b486-6e152a39014d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:13.843043 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15189f8a-24ac-4a74-b486-6e152a39014d None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:13.843323 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15189f8a-24ac-4a74-b486-6e152a39014d None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:13.843594 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15189f8a-24ac-4a74-b486-6e152a39014d None admin] PATH_INFO: `/v3/services` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:13.844235 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15189f8a-24ac-4a74-b486-6e152a39014d None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=88081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:22:13.844537 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15189f8a-24ac-4a74-b486-6e152a39014d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:13.846015 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15189f8a-24ac-4a74-b486-6e152a39014d None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:13.853291 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 324/644] 10.222.0.18 () {56 vars in 1124 bytes} [Sat Sep 24 19:22:13 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:22:15.736333 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80992ad6-5e6f-49b4-bb14-9d443ea7ab27 None None] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:15.737316 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80992ad6-5e6f-49b4-bb14-9d443ea7ab27 None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:15.737788 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80992ad6-5e6f-49b4-bb14-9d443ea7ab27 None None] PATH_INFO: `/` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:15.740177 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 321/645] 10.222.0.18 () {54 vars in 927 bytes} [Sat Sep 24 19:22:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:22:15.745955 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c500c3bc-62a6-4730-a8e7-d966a80dfad5 None None] REQUEST_METHOD: `POST` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:15.746859 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c500c3bc-62a6-4730-a8e7-d966a80dfad5 None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:15.747452 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c500c3bc-62a6-4730-a8e7-d966a80dfad5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:15.779447 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.auth.core [None req-c500c3bc-62a6-4730-a8e7-d966a80dfad5 None None] MFA Rules not processed for user `3dbbb9909cec43ff99c1c3682f016ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=88081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:22:15.780993 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.fernet_utils [None req-c500c3bc-62a6-4730-a8e7-d966a80dfad5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:22:15.859087 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 325/646] 10.222.0.18 () {58 vars in 1024 bytes} [Sat Sep 24 19:22:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:22:15.905997 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c2b25b-adf3-4585-bc9e-336284168064 None None] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:15.906650 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c2b25b-adf3-4585-bc9e-336284168064 None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:15.907120 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c2b25b-adf3-4585-bc9e-336284168064 None None] PATH_INFO: `/` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:15.908988 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 322/647] 10.222.0.18 () {54 vars in 927 bytes} [Sat Sep 24 19:22:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:22:15.914056 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff92665-2198-4b0d-be84-235405289a50 None None] REQUEST_METHOD: `POST` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:15.914341 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff92665-2198-4b0d-be84-235405289a50 None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:15.914614 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff92665-2198-4b0d-be84-235405289a50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:15.934139 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.auth.core [None req-3ff92665-2198-4b0d-be84-235405289a50 None None] MFA Rules not processed for user `3dbbb9909cec43ff99c1c3682f016ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=88081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:22:15.935837 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.fernet_utils [None req-3ff92665-2198-4b0d-be84-235405289a50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:22:16.047800 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 326/648] 10.222.0.18 () {58 vars in 1024 bytes} [Sat Sep 24 19:22:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:22:16.196818 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c2b25b-adf3-4585-bc9e-336284168064 None None] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:16.230609 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:22:16.318899 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c2b25b-adf3-4585-bc9e-336284168064 None None] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:16.371072 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ebb7da-cc27-45e4-89e1-85d6c47cec09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:16.371768 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ebb7da-cc27-45e4-89e1-85d6c47cec09 None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:16.372131 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ebb7da-cc27-45e4-89e1-85d6c47cec09 None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:16.372604 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ebb7da-cc27-45e4-89e1-85d6c47cec09 None admin] PATH_INFO: `/v3/services/network` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:16.373533 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ebb7da-cc27-45e4-89e1-85d6c47cec09 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:16.375625 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ebb7da-cc27-45e4-89e1-85d6c47cec09 None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:16.392022 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application [None req-e4ebb7da-cc27-45e4-89e1-85d6c47cec09 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 24 19:22:16.392022 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:22:16.392022 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 24 19:22:16.392022 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 24 19:22:16.392022 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 24 19:22:16.392022 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 24 19:22:16.392022 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 24 19:22:16.392022 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 19:22:16.392022 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 24 19:22:16.392022 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Sep 24 19:22:16.392022 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 24 19:22:16.392022 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Sep 24 19:22:16.392022 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:22:16.392022 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:22:16.392022 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:22:16.392022 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:22:16.392022 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:22:16.394020 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:22:16.394020 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:22:16.394020 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:22:16.394020 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:22:16.394020 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:22:16.394020 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:22:16.394020 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 24 19:22:16.394020 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 24 19:22:16.394020 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 24 19:22:16.394020 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 24 19:22:16.394020 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:22:16.394020 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:22:16.394020 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:22:16.394020 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:22:16.394020 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:22:16.394020 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:22:16.394876 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:22:16.394876 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application with Lock( Sep 24 19:22:16.394876 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:22:16.394876 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:22:16.394876 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:22:16.394876 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:22:16.394876 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:22:16.394876 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:22:16.394876 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:22:16.394876 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:22:16.394876 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 24 19:22:16.394876 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 19:22:16.394876 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 24 19:22:16.394876 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Sep 24 19:22:16.394876 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 323/649] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Sep 24 19:22:16 2022] GET /identity/v3/services/network => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:22:16.403019 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff92665-2198-4b0d-be84-235405289a50 None None] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:16.441732 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ebb7da-cc27-45e4-89e1-85d6c47cec09 None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:16.450465 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:22:16.539166 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff92665-2198-4b0d-be84-235405289a50 None None] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:16.564978 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:22:16.576644 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ebb7da-cc27-45e4-89e1-85d6c47cec09 None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:16.578447 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0838aa0b-9d3b-4801-825c-22748c33b10c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:16.579232 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0838aa0b-9d3b-4801-825c-22748c33b10c None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:16.579596 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0838aa0b-9d3b-4801-825c-22748c33b10c None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:16.579881 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0838aa0b-9d3b-4801-825c-22748c33b10c None admin] PATH_INFO: `/v3/services` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:16.580609 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0838aa0b-9d3b-4801-825c-22748c33b10c None admin] RBAC: Adding query filter params (name=network) {{(pid=88081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:22:16.580915 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0838aa0b-9d3b-4801-825c-22748c33b10c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:16.582588 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0838aa0b-9d3b-4801-825c-22748c33b10c None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:16.587362 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 327/650] 10.222.0.18 () {56 vars in 1112 bytes} [Sat Sep 24 19:22:16 2022] GET /identity/v3/services?name=network => generated 124 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:22:16.588781 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cd952b-5918-4b4a-80ca-dde466733aa4 None None] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:16.589080 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cd952b-5918-4b4a-80ca-dde466733aa4 None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:16.589338 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cd952b-5918-4b4a-80ca-dde466733aa4 None None] PATH_INFO: `/` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:16.592555 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 328/651] 10.222.0.18 () {54 vars in 927 bytes} [Sat Sep 24 19:22:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:22:16.592555 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f438309-6297-4c83-824c-990b2385d4a7 None None] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:16.592555 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f438309-6297-4c83-824c-990b2385d4a7 None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:16.592838 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f438309-6297-4c83-824c-990b2385d4a7 None None] PATH_INFO: `/` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:16.597892 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 329/652] 10.222.0.18 () {54 vars in 927 bytes} [Sat Sep 24 19:22:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:22:16.597892 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f438309-6297-4c83-824c-990b2385d4a7 None None] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:16.626645 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf504d25-16bf-4a21-91a2-215f3671f16d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:16.627535 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf504d25-16bf-4a21-91a2-215f3671f16d None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:16.627975 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf504d25-16bf-4a21-91a2-215f3671f16d None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:16.628465 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf504d25-16bf-4a21-91a2-215f3671f16d None admin] PATH_INFO: `/v3/services/image` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:16.629312 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf504d25-16bf-4a21-91a2-215f3671f16d None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:16.631458 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf504d25-16bf-4a21-91a2-215f3671f16d None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:16.641800 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application [None req-cf504d25-16bf-4a21-91a2-215f3671f16d None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 24 19:22:16.641800 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:22:16.641800 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 24 19:22:16.641800 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 24 19:22:16.641800 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 24 19:22:16.641800 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 24 19:22:16.641800 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 24 19:22:16.641800 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 19:22:16.641800 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 24 19:22:16.641800 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Sep 24 19:22:16.641800 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 24 19:22:16.641800 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Sep 24 19:22:16.641800 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:22:16.641800 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:22:16.641800 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:22:16.641800 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:22:16.641800 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:22:16.643061 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:22:16.643061 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:22:16.643061 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:22:16.643061 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:22:16.643061 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:22:16.643061 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:22:16.643061 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 24 19:22:16.643061 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 24 19:22:16.643061 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 24 19:22:16.643061 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 24 19:22:16.643061 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:22:16.643061 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:22:16.643061 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:22:16.643061 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:22:16.643061 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:22:16.643061 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:22:16.643894 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:22:16.643894 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application with Lock( Sep 24 19:22:16.643894 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:22:16.643894 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:22:16.643894 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:22:16.643894 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:22:16.643894 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:22:16.643894 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:22:16.643894 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:22:16.643894 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:22:16.643894 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 24 19:22:16.643894 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 19:22:16.643894 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 24 19:22:16.643894 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Sep 24 19:22:16.643894 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 324/653] 10.222.0.18 () {56 vars in 1105 bytes} [Sat Sep 24 19:22:16 2022] GET /identity/v3/services/image => generated 86 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 19:22:16.644703 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8f6c03-9188-467e-b269-6ef861df18ba None None] REQUEST_METHOD: `POST` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:16.644832 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8f6c03-9188-467e-b269-6ef861df18ba None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:16.645123 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8f6c03-9188-467e-b269-6ef861df18ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:16.664837 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.auth.core [None req-4b8f6c03-9188-467e-b269-6ef861df18ba None None] MFA Rules not processed for user `3dbbb9909cec43ff99c1c3682f016ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=88080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:22:16.666076 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.fernet_utils [None req-4b8f6c03-9188-467e-b269-6ef861df18ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:22:16.728478 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:22:16.737883 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f438309-6297-4c83-824c-990b2385d4a7 None None] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:16.765866 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 325/654] 10.222.0.18 () {58 vars in 1024 bytes} [Sat Sep 24 19:22:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:22:16.765866 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4760ad04-bd3b-434a-84d6-4eb96983c37e None None] REQUEST_METHOD: `POST` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:16.765866 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4760ad04-bd3b-434a-84d6-4eb96983c37e None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:16.765866 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4760ad04-bd3b-434a-84d6-4eb96983c37e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:16.768422 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.auth.core [None req-4760ad04-bd3b-434a-84d6-4eb96983c37e None None] MFA Rules not processed for user `3dbbb9909cec43ff99c1c3682f016ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=88080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:22:16.769597 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.fernet_utils [None req-4760ad04-bd3b-434a-84d6-4eb96983c37e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:22:16.791207 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8622de-46b2-4ed1-9246-59460b688fc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:16.791811 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8622de-46b2-4ed1-9246-59460b688fc5 None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:16.792272 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8622de-46b2-4ed1-9246-59460b688fc5 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:16.792699 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8622de-46b2-4ed1-9246-59460b688fc5 None admin] PATH_INFO: `/v3/services` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:16.793340 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8622de-46b2-4ed1-9246-59460b688fc5 None admin] RBAC: Adding query filter params (type=network) {{(pid=88081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:22:16.793646 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8622de-46b2-4ed1-9246-59460b688fc5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:16.795102 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8622de-46b2-4ed1-9246-59460b688fc5 None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:16.810754 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 330/655] 10.222.0.18 () {56 vars in 1112 bytes} [Sat Sep 24 19:22:16 2022] GET /identity/v3/services?type=network => generated 124 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:22:16.810754 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8622de-46b2-4ed1-9246-59460b688fc5 None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:16.920867 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 326/656] 10.222.0.18 () {58 vars in 1024 bytes} [Sat Sep 24 19:22:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 19:22:16.975877 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8622de-46b2-4ed1-9246-59460b688fc5 None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:17.019499 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affb82be-a6ea-43d0-ac67-434de2742c71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:17.020320 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affb82be-a6ea-43d0-ac67-434de2742c71 None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:17.020654 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affb82be-a6ea-43d0-ac67-434de2742c71 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:17.021005 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affb82be-a6ea-43d0-ac67-434de2742c71 None admin] PATH_INFO: `/v3/services` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:17.021676 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affb82be-a6ea-43d0-ac67-434de2742c71 None admin] RBAC: Adding query filter params (name=image) {{(pid=88081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:22:17.022077 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affb82be-a6ea-43d0-ac67-434de2742c71 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:17.024960 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affb82be-a6ea-43d0-ac67-434de2742c71 None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:17.031741 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 331/657] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Sep 24 19:22:16 2022] GET /identity/v3/services?name=image => generated 122 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:22:17.037321 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4760ad04-bd3b-434a-84d6-4eb96983c37e None None] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:17.059150 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:22:17.077856 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affb82be-a6ea-43d0-ac67-434de2742c71 None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:17.115354 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:22:17.195068 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4760ad04-bd3b-434a-84d6-4eb96983c37e None None] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:17.207282 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affb82be-a6ea-43d0-ac67-434de2742c71 None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:17.252270 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6239ef27-9a58-487e-bc68-b739a4e7dad4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:17.252877 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6239ef27-9a58-487e-bc68-b739a4e7dad4 None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:17.253150 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6239ef27-9a58-487e-bc68-b739a4e7dad4 None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:17.253421 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6239ef27-9a58-487e-bc68-b739a4e7dad4 None admin] PATH_INFO: `/v3/services` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:17.254100 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6239ef27-9a58-487e-bc68-b739a4e7dad4 None admin] RBAC: Adding query filter params (type=image) {{(pid=88080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:22:17.254396 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6239ef27-9a58-487e-bc68-b739a4e7dad4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:17.255769 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6239ef27-9a58-487e-bc68-b739a4e7dad4 None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:17.257486 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be67f6a6-ab60-4aa3-b17d-f51a05eaeb4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:17.258835 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be67f6a6-ab60-4aa3-b17d-f51a05eaeb4f None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:17.259518 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be67f6a6-ab60-4aa3-b17d-f51a05eaeb4f None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:17.260065 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be67f6a6-ab60-4aa3-b17d-f51a05eaeb4f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:17.268656 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 327/658] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Sep 24 19:22:17 2022] GET /identity/v3/services?type=image => generated 122 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:22:17.269787 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6239ef27-9a58-487e-bc68-b739a4e7dad4 None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:17.284689 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be67f6a6-ab60-4aa3-b17d-f51a05eaeb4f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:22:17.291541 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application [None req-be67f6a6-ab60-4aa3-b17d-f51a05eaeb4f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 19:22:17.291541 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:22:17.291541 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:22:17.291541 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:22:17.291541 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:22:17.291541 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:22:17.291541 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:22:17.291541 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:22:17.291541 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:22:17.291541 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:22:17.291541 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:22:17.291541 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:22:17.291541 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:22:17.291541 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:22:17.291541 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:22:17.291541 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:22:17.292715 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:22:17.292715 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:22:17.292715 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:22:17.292715 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:22:17.292715 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:22:17.292715 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:22:17.292715 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:22:17.292715 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:22:17.292715 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:22:17.292715 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:22:17.292715 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:22:17.292715 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application with Lock( Sep 24 19:22:17.292715 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:22:17.292715 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:22:17.292715 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:22:17.292715 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:22:17.293623 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:22:17.293623 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:22:17.293623 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:22:17.293623 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:22:17.293623 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:22:17.293623 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:22:17.293623 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:22:17.293623 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:22:17.293623 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:22:17.293623 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:22:17.293623 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 19:22:17.293623 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Sep 24 19:22:17.302678 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 332/659] 10.222.0.18 () {56 vars in 1096 bytes} [Sat Sep 24 19:22:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 19:22:17.304631 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be67f6a6-ab60-4aa3-b17d-f51a05eaeb4f None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:17.398261 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:22:17.420363 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6239ef27-9a58-487e-bc68-b739a4e7dad4 None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:17.444466 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:22:17.462481 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be67f6a6-ab60-4aa3-b17d-f51a05eaeb4f None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:17.483350 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b0fb59-8aab-46da-ad66-1537512564b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:17.484439 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b0fb59-8aab-46da-ad66-1537512564b6 None admin] REQUEST_METHOD: `POST` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:17.484850 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b0fb59-8aab-46da-ad66-1537512564b6 None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:17.485285 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b0fb59-8aab-46da-ad66-1537512564b6 None admin] PATH_INFO: `/v3/services` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:17.486462 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b0fb59-8aab-46da-ad66-1537512564b6 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:17.488913 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b0fb59-8aab-46da-ad66-1537512564b6 None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:17.509880 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 328/660] 10.222.0.18 () {60 vars in 1141 bytes} [Sat Sep 24 19:22:17 2022] POST /identity/v3/services => generated 251 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:22:17.541020 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48076796-9d88-4313-a454-3483fbbf2bd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:17.541687 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48076796-9d88-4313-a454-3483fbbf2bd3 None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:17.542032 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48076796-9d88-4313-a454-3483fbbf2bd3 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:17.542377 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48076796-9d88-4313-a454-3483fbbf2bd3 None admin] PATH_INFO: `/v3/roles` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:17.543167 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48076796-9d88-4313-a454-3483fbbf2bd3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:22:17.543480 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48076796-9d88-4313-a454-3483fbbf2bd3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:17.545731 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48076796-9d88-4313-a454-3483fbbf2bd3 None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:17.564865 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 333/661] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Sep 24 19:22:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:22:17.573978 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b0fb59-8aab-46da-ad66-1537512564b6 None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:17.711706 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b0fb59-8aab-46da-ad66-1537512564b6 None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:17.760160 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903b1b86-7acd-4627-aca9-d48f8a662a00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:17.761102 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903b1b86-7acd-4627-aca9-d48f8a662a00 None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:17.761681 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903b1b86-7acd-4627-aca9-d48f8a662a00 None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:17.762163 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903b1b86-7acd-4627-aca9-d48f8a662a00 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:17.779130 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:22:17.781194 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903b1b86-7acd-4627-aca9-d48f8a662a00 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:17.782913 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903b1b86-7acd-4627-aca9-d48f8a662a00 None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:17.802289 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application [None req-903b1b86-7acd-4627-aca9-d48f8a662a00 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:22:17.802289 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:22:17.802289 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:22:17.802289 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:22:17.802289 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:22:17.802289 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:22:17.802289 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:22:17.802289 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:22:17.802289 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:22:17.802289 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:22:17.802289 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:22:17.802289 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:22:17.802289 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:22:17.802289 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:22:17.802289 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:22:17.802289 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:22:17.803554 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:22:17.803554 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:22:17.803554 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:22:17.803554 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:22:17.803554 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:22:17.803554 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:22:17.803554 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:22:17.803554 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application with Lock( Sep 24 19:22:17.803554 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:22:17.803554 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:22:17.803554 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:22:17.803554 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:22:17.803554 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:22:17.803554 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:22:17.803554 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:22:17.803554 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:22:17.803554 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:22:17.804667 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:22:17.804667 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:22:17.804667 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Sep 24 19:22:17.805367 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 329/662] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Sep 24 19:22:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:22:17.811509 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48076796-9d88-4313-a454-3483fbbf2bd3 None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:17.965270 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48076796-9d88-4313-a454-3483fbbf2bd3 None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:18.005541 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f415e97e-a4ed-4e06-b767-fe1b53ae3f27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:18.006190 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f415e97e-a4ed-4e06-b767-fe1b53ae3f27 None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:18.006475 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f415e97e-a4ed-4e06-b767-fe1b53ae3f27 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:18.006750 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f415e97e-a4ed-4e06-b767-fe1b53ae3f27 None admin] PATH_INFO: `/v3/domains` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:18.007394 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f415e97e-a4ed-4e06-b767-fe1b53ae3f27 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:22:18.007696 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f415e97e-a4ed-4e06-b767-fe1b53ae3f27 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:18.009121 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f415e97e-a4ed-4e06-b767-fe1b53ae3f27 None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:18.022478 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 334/663] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Sep 24 19:22:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:22:18.031293 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903b1b86-7acd-4627-aca9-d48f8a662a00 None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:18.183553 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903b1b86-7acd-4627-aca9-d48f8a662a00 None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:18.241575 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3911379-1e18-4feb-bd71-3a51891475cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:18.242719 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3911379-1e18-4feb-bd71-3a51891475cb None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:18.243201 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3911379-1e18-4feb-bd71-3a51891475cb None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:18.243672 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3911379-1e18-4feb-bd71-3a51891475cb None admin] PATH_INFO: `/v3/users/nova` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:18.258439 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3911379-1e18-4feb-bd71-3a51891475cb None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:18.260569 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3911379-1e18-4feb-bd71-3a51891475cb None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:18.275150 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application [None req-e3911379-1e18-4feb-bd71-3a51891475cb None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 24 19:22:18.275150 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:22:18.275150 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:22:18.275150 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:22:18.275150 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:22:18.275150 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:22:18.275150 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:22:18.275150 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:22:18.275150 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:22:18.275150 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:22:18.275150 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:22:18.275150 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:22:18.275150 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 24 19:22:18.275150 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 24 19:22:18.275150 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 24 19:22:18.275150 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 24 19:22:18.276332 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:22:18.276332 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:22:18.276332 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 24 19:22:18.276332 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 19:22:18.276332 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 24 19:22:18.276332 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 19:22:18.276332 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:22:18.276332 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:22:18.276332 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:22:18.276332 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:22:18.276332 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:22:18.276332 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application with Lock( Sep 24 19:22:18.276332 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:22:18.276332 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:22:18.276332 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:22:18.276332 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:22:18.276332 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:22:18.276332 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:22:18.277472 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:22:18.277472 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:22:18.277472 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 24 19:22:18.277472 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 24 19:22:18.277472 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 24 19:22:18.277472 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 24 19:22:18.277472 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 24 19:22:18.277472 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 24 19:22:18.277472 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 24 19:22:18.277472 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Sep 24 19:22:18.281002 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 330/664] 10.222.0.18 () {56 vars in 1093 bytes} [Sat Sep 24 19:22:18 2022] GET /identity/v3/users/nova => generated 82 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:22:18.282733 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f415e97e-a4ed-4e06-b767-fe1b53ae3f27 None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:18.295130 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:22:18.403017 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f415e97e-a4ed-4e06-b767-fe1b53ae3f27 None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:18.443014 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089ace69-0234-4214-a12d-badd8fda439c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:18.444044 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089ace69-0234-4214-a12d-badd8fda439c None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:18.444507 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089ace69-0234-4214-a12d-badd8fda439c None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:18.445006 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089ace69-0234-4214-a12d-badd8fda439c None admin] PATH_INFO: `/v3/users` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:18.445959 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089ace69-0234-4214-a12d-badd8fda439c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:22:18.446450 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089ace69-0234-4214-a12d-badd8fda439c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:18.448161 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089ace69-0234-4214-a12d-badd8fda439c None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:18.469986 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 335/665] 10.222.0.18 () {56 vars in 1133 bytes} [Sat Sep 24 19:22:18 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:22:18.478798 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3911379-1e18-4feb-bd71-3a51891475cb None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:18.567893 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:22:18.777613 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3911379-1e18-4feb-bd71-3a51891475cb None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:18.816041 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d32075-27d8-4764-8c23-371915eb9026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:18.816670 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d32075-27d8-4764-8c23-371915eb9026 None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:18.816898 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d32075-27d8-4764-8c23-371915eb9026 None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:18.817166 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d32075-27d8-4764-8c23-371915eb9026 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:18.895442 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d32075-27d8-4764-8c23-371915eb9026 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:18.896898 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d32075-27d8-4764-8c23-371915eb9026 None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:18.968281 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:22:19.012889 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 331/666] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Sep 24 19:22:18 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 531 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 24 19:22:19.014398 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089ace69-0234-4214-a12d-badd8fda439c None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:19.094217 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:22:19.143530 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089ace69-0234-4214-a12d-badd8fda439c None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:19.184051 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea3684e-b7d0-42b6-9ed3-dbcabce56560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:19.185637 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea3684e-b7d0-42b6-9ed3-dbcabce56560 None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:19.186163 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea3684e-b7d0-42b6-9ed3-dbcabce56560 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:19.186639 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea3684e-b7d0-42b6-9ed3-dbcabce56560 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:19.199977 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea3684e-b7d0-42b6-9ed3-dbcabce56560 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:19.201865 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea3684e-b7d0-42b6-9ed3-dbcabce56560 None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:19.223610 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application [None req-1ea3684e-b7d0-42b6-9ed3-dbcabce56560 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:22:19.223610 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:22:19.223610 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:22:19.223610 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:22:19.223610 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:22:19.223610 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:22:19.223610 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:22:19.223610 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:22:19.223610 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:22:19.223610 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:22:19.223610 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:22:19.223610 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:22:19.223610 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:22:19.223610 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:22:19.223610 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:22:19.223610 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:22:19.225481 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:22:19.225481 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:22:19.225481 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:22:19.225481 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:22:19.225481 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:22:19.225481 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:22:19.225481 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:22:19.225481 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application with Lock( Sep 24 19:22:19.225481 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:22:19.225481 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:22:19.225481 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:22:19.225481 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:22:19.225481 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:22:19.225481 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:22:19.225481 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:22:19.225481 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:22:19.225481 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:22:19.227636 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:22:19.227636 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:22:19.227636 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Sep 24 19:22:19.232617 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 336/667] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Sep 24 19:22:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:22:19.238664 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d32075-27d8-4764-8c23-371915eb9026 None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:19.355538 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d32075-27d8-4764-8c23-371915eb9026 None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:19.395370 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0879ae-5e6f-4f08-bfbd-05bcce9bf4ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:19.396067 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0879ae-5e6f-4f08-bfbd-05bcce9bf4ae None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:19.396432 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0879ae-5e6f-4f08-bfbd-05bcce9bf4ae None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:19.396703 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0879ae-5e6f-4f08-bfbd-05bcce9bf4ae None admin] PATH_INFO: `/v3/domains` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:19.397355 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0879ae-5e6f-4f08-bfbd-05bcce9bf4ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=88080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:22:19.397751 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0879ae-5e6f-4f08-bfbd-05bcce9bf4ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:19.399400 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0879ae-5e6f-4f08-bfbd-05bcce9bf4ae None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:19.418104 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 332/668] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Sep 24 19:22:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:22:19.420620 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea3684e-b7d0-42b6-9ed3-dbcabce56560 None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:19.554129 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8fb220-753d-456e-b716-74235eb19d08 None None] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:19.554531 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8fb220-753d-456e-b716-74235eb19d08 None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:19.554994 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8fb220-753d-456e-b716-74235eb19d08 None None] PATH_INFO: `/` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:19.562079 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 333/669] 10.222.0.18 () {54 vars in 927 bytes} [Sat Sep 24 19:22:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:22:19.566117 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46534144-fa30-4b78-a859-34813994d250 None None] REQUEST_METHOD: `POST` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:19.566432 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46534144-fa30-4b78-a859-34813994d250 None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:19.566704 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46534144-fa30-4b78-a859-34813994d250 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:19.566878 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea3684e-b7d0-42b6-9ed3-dbcabce56560 None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:19.586066 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:22:19.596744 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.auth.core [None req-46534144-fa30-4b78-a859-34813994d250 None None] MFA Rules not processed for user `3dbbb9909cec43ff99c1c3682f016ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=88080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:22:19.598080 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.fernet_utils [None req-46534144-fa30-4b78-a859-34813994d250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:22:19.606754 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c005b25f-774b-4b76-8f17-412b2a4d13b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:19.607433 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c005b25f-774b-4b76-8f17-412b2a4d13b0 None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:19.607709 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c005b25f-774b-4b76-8f17-412b2a4d13b0 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:19.607978 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c005b25f-774b-4b76-8f17-412b2a4d13b0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:19.614238 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:22:19.615773 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c005b25f-774b-4b76-8f17-412b2a4d13b0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:19.617230 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c005b25f-774b-4b76-8f17-412b2a4d13b0 None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:19.630545 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application [None req-c005b25f-774b-4b76-8f17-412b2a4d13b0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 19:22:19.630545 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:22:19.630545 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:22:19.630545 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:22:19.630545 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:22:19.630545 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:22:19.630545 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:22:19.630545 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:22:19.630545 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:22:19.630545 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:22:19.630545 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:22:19.630545 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:22:19.630545 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 24 19:22:19.630545 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 24 19:22:19.630545 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 24 19:22:19.631498 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 24 19:22:19.631498 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:22:19.631498 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:22:19.631498 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:22:19.631498 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:22:19.631498 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:22:19.631498 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:22:19.631498 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:22:19.631498 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application with Lock( Sep 24 19:22:19.631498 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:22:19.631498 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:22:19.631498 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:22:19.631498 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:22:19.631498 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:22:19.631498 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:22:19.631498 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:22:19.631498 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:22:19.632455 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 24 19:22:19.632455 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 24 19:22:19.632455 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 24 19:22:19.632455 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 24 19:22:19.632455 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 24 19:22:19.632455 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 24 19:22:19.632455 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 19:22:19.632455 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Sep 24 19:22:19.632455 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 337/670] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Sep 24 19:22:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:22:19.644337 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c005b25f-774b-4b76-8f17-412b2a4d13b0 None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:19.731904 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 334/671] 10.222.0.18 () {58 vars in 1024 bytes} [Sat Sep 24 19:22:19 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 24 19:22:19.851043 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c005b25f-774b-4b76-8f17-412b2a4d13b0 None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:19.918505 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0b7bc9-522b-43f7-92db-0aaca2c85c14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:19.919173 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0b7bc9-522b-43f7-92db-0aaca2c85c14 None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:19.919507 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0b7bc9-522b-43f7-92db-0aaca2c85c14 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:19.919780 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0b7bc9-522b-43f7-92db-0aaca2c85c14 None admin] PATH_INFO: `/v3/projects` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:19.920965 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0b7bc9-522b-43f7-92db-0aaca2c85c14 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:22:19.922224 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0b7bc9-522b-43f7-92db-0aaca2c85c14 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:19.924738 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0b7bc9-522b-43f7-92db-0aaca2c85c14 None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:19.944242 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 338/672] 10.222.0.18 () {56 vars in 1148 bytes} [Sat Sep 24 19:22:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:22:19.952852 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46534144-fa30-4b78-a859-34813994d250 None None] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:20.066738 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0b7bc9-522b-43f7-92db-0aaca2c85c14 None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:20.080568 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46534144-fa30-4b78-a859-34813994d250 None None] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:20.125325 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdc2a4c-c365-4ea2-9de4-a3426310ab9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:20.125868 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdc2a4c-c365-4ea2-9de4-a3426310ab9b None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:20.126150 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdc2a4c-c365-4ea2-9de4-a3426310ab9b None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:20.126426 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdc2a4c-c365-4ea2-9de4-a3426310ab9b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:20.127174 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdc2a4c-c365-4ea2-9de4-a3426310ab9b None admin] RBAC: Adding query filter params (role.id=4c7d0dafc19b4b0a9821be6ec0da0a8f, scope.project.id=9dfa5c2c17244006bdd629ec81553f1a, user.id=0ab73abe1c6e4b25a17281f4cd8e97e9) {{(pid=88080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:22:20.127482 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdc2a4c-c365-4ea2-9de4-a3426310ab9b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:20.128972 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdc2a4c-c365-4ea2-9de4-a3426310ab9b None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:20.131503 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:22:20.139375 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 335/673] 10.222.0.18 () {56 vars in 1374 bytes} [Sat Sep 24 19:22:19 2022] GET /identity/v3/role_assignments?user.id=0ab73abe1c6e4b25a17281f4cd8e97e9&scope.project.id=9dfa5c2c17244006bdd629ec81553f1a&role.id=4c7d0dafc19b4b0a9821be6ec0da0a8f => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:22:20.139375 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f28f76-fe34-4b98-8dbf-fd3387d5313d None None] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:20.139375 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f28f76-fe34-4b98-8dbf-fd3387d5313d None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:20.139375 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f28f76-fe34-4b98-8dbf-fd3387d5313d None None] PATH_INFO: `/` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:20.139375 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 336/674] 10.222.0.18 () {54 vars in 927 bytes} [Sat Sep 24 19:22:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:22:20.146362 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced573a5-efe4-4f0a-b5f7-0693caec71c0 None None] REQUEST_METHOD: `POST` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:20.146638 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced573a5-efe4-4f0a-b5f7-0693caec71c0 None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:20.146906 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced573a5-efe4-4f0a-b5f7-0693caec71c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:20.162227 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:22:20.168825 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.auth.core [None req-ced573a5-efe4-4f0a-b5f7-0693caec71c0 None None] MFA Rules not processed for user `3dbbb9909cec43ff99c1c3682f016ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=88080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:22:20.171310 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.fernet_utils [None req-ced573a5-efe4-4f0a-b5f7-0693caec71c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:22:20.270417 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 337/675] 10.222.0.18 () {58 vars in 1024 bytes} [Sat Sep 24 19:22:20 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 24 19:22:20.279625 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0b7bc9-522b-43f7-92db-0aaca2c85c14 None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:20.301813 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82031253-0624-4f37-9e5a-1ac8a23ecc06 None None] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:20.302493 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82031253-0624-4f37-9e5a-1ac8a23ecc06 None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:20.302863 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82031253-0624-4f37-9e5a-1ac8a23ecc06 None None] PATH_INFO: `/` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:20.304722 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 338/676] 10.222.0.18 () {54 vars in 927 bytes} [Sat Sep 24 19:22:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 24 19:22:20.312404 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bca05b-2274-49e8-9801-b5f773e4b41c None None] REQUEST_METHOD: `POST` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:20.312879 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bca05b-2274-49e8-9801-b5f773e4b41c None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:20.313252 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bca05b-2274-49e8-9801-b5f773e4b41c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:20.339936 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8897a941-34ed-4cbb-b46d-f65491c58e4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:20.341316 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8897a941-34ed-4cbb-b46d-f65491c58e4f None admin] REQUEST_METHOD: `POST` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:20.341861 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8897a941-34ed-4cbb-b46d-f65491c58e4f None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:20.342547 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8897a941-34ed-4cbb-b46d-f65491c58e4f None admin] PATH_INFO: `/v3/services` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:20.343050 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.auth.core [None req-a2bca05b-2274-49e8-9801-b5f773e4b41c None None] MFA Rules not processed for user `3dbbb9909cec43ff99c1c3682f016ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=88080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:22:20.343828 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8897a941-34ed-4cbb-b46d-f65491c58e4f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:20.344628 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.fernet_utils [None req-a2bca05b-2274-49e8-9801-b5f773e4b41c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:22:20.345920 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8897a941-34ed-4cbb-b46d-f65491c58e4f None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:20.381173 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 339/677] 10.222.0.18 () {60 vars in 1141 bytes} [Sat Sep 24 19:22:20 2022] POST /identity/v3/services => generated 240 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 24 19:22:20.491402 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 339/678] 10.222.0.18 () {58 vars in 1024 bytes} [Sat Sep 24 19:22:20 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 24 19:22:20.599055 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8897a941-34ed-4cbb-b46d-f65491c58e4f None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:20.711113 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:22:20.719784 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8897a941-34ed-4cbb-b46d-f65491c58e4f None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:20.757337 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a94f725-920a-4542-b7a4-69abb74b2241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:20.758358 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a94f725-920a-4542-b7a4-69abb74b2241 None admin] REQUEST_METHOD: `POST` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:20.758996 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a94f725-920a-4542-b7a4-69abb74b2241 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:20.759191 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a94f725-920a-4542-b7a4-69abb74b2241 None admin] PATH_INFO: `/v3/services` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:20.765863 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a94f725-920a-4542-b7a4-69abb74b2241 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:20.765863 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a94f725-920a-4542-b7a4-69abb74b2241 None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:20.780376 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 340/679] 10.222.0.18 () {60 vars in 1141 bytes} [Sat Sep 24 19:22:20 2022] POST /identity/v3/services => generated 242 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:22:20.837243 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bca05b-2274-49e8-9801-b5f773e4b41c None None] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:20.918618 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:22:20.969385 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bca05b-2274-49e8-9801-b5f773e4b41c None None] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:21.015334 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169cad92-cad4-4fc7-a384-b3e0c6b1b30c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:21.015989 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169cad92-cad4-4fc7-a384-b3e0c6b1b30c None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:21.016546 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169cad92-cad4-4fc7-a384-b3e0c6b1b30c None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:21.016546 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169cad92-cad4-4fc7-a384-b3e0c6b1b30c None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:21.017266 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169cad92-cad4-4fc7-a384-b3e0c6b1b30c None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:21.018766 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169cad92-cad4-4fc7-a384-b3e0c6b1b30c None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:21.030076 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application [None req-169cad92-cad4-4fc7-a384-b3e0c6b1b30c None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 24 19:22:21.030076 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:22:21.030076 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 24 19:22:21.030076 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 24 19:22:21.030076 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 24 19:22:21.030076 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 24 19:22:21.030076 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 24 19:22:21.030076 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 19:22:21.030076 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 24 19:22:21.030076 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Sep 24 19:22:21.030076 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 24 19:22:21.030076 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Sep 24 19:22:21.030076 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:22:21.030076 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:22:21.030076 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:22:21.030076 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:22:21.030076 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:22:21.031294 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:22:21.031294 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:22:21.031294 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:22:21.031294 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:22:21.031294 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:22:21.031294 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:22:21.031294 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 24 19:22:21.031294 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 24 19:22:21.031294 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 24 19:22:21.031294 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 24 19:22:21.031294 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:22:21.031294 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:22:21.031294 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:22:21.031294 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:22:21.031294 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:22:21.031294 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:22:21.032229 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:22:21.032229 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application with Lock( Sep 24 19:22:21.032229 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:22:21.032229 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:22:21.032229 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:22:21.032229 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:22:21.032229 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:22:21.032229 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:22:21.032229 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:22:21.032229 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:22:21.032229 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 24 19:22:21.032229 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 19:22:21.032229 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 24 19:22:21.032229 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Sep 24 19:22:21.033202 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 340/680] 10.222.0.18 () {56 vars in 1129 bytes} [Sat Sep 24 19:22:20 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:22:21.037365 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a94f725-920a-4542-b7a4-69abb74b2241 None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:21.181025 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a94f725-920a-4542-b7a4-69abb74b2241 None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:21.222186 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8132b34d-e051-415d-a23c-7d157e91ac50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:21.222729 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8132b34d-e051-415d-a23c-7d157e91ac50 None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:21.223005 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8132b34d-e051-415d-a23c-7d157e91ac50 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:21.223279 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8132b34d-e051-415d-a23c-7d157e91ac50 None admin] PATH_INFO: `/v3/services` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:21.224066 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8132b34d-e051-415d-a23c-7d157e91ac50 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=88081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:22:21.224391 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8132b34d-e051-415d-a23c-7d157e91ac50 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:21.225848 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8132b34d-e051-415d-a23c-7d157e91ac50 None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:21.232494 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 341/681] 10.222.0.18 () {56 vars in 1124 bytes} [Sat Sep 24 19:22:21 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:22:21.240612 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169cad92-cad4-4fc7-a384-b3e0c6b1b30c None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:21.359612 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169cad92-cad4-4fc7-a384-b3e0c6b1b30c None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:21.385749 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:22:21.398221 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f88107d-cb0a-4402-8399-0d85e3958989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:21.399047 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f88107d-cb0a-4402-8399-0d85e3958989 None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:21.399387 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f88107d-cb0a-4402-8399-0d85e3958989 None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:21.399876 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f88107d-cb0a-4402-8399-0d85e3958989 None admin] PATH_INFO: `/v3/services` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:21.400525 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f88107d-cb0a-4402-8399-0d85e3958989 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=88080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:22:21.400829 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f88107d-cb0a-4402-8399-0d85e3958989 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:21.402277 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f88107d-cb0a-4402-8399-0d85e3958989 None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:21.408836 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 341/682] 10.222.0.18 () {56 vars in 1124 bytes} [Sat Sep 24 19:22:21 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:22:21.414740 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8132b34d-e051-415d-a23c-7d157e91ac50 None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:21.440354 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:22:21.536321 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8132b34d-e051-415d-a23c-7d157e91ac50 None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:21.572196 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0163a3de-1e39-443c-9dba-9c26e3750586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:21.572824 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0163a3de-1e39-443c-9dba-9c26e3750586 None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:21.573103 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0163a3de-1e39-443c-9dba-9c26e3750586 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:21.573375 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0163a3de-1e39-443c-9dba-9c26e3750586 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:21.574110 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0163a3de-1e39-443c-9dba-9c26e3750586 None admin] RBAC: Adding query filter params (interface=public, service_id=2356c836f6eb46cf8f1b5b7c0ba53fd7, region_id=RegionOne) {{(pid=88081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:22:21.574419 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0163a3de-1e39-443c-9dba-9c26e3750586 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:21.576305 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0163a3de-1e39-443c-9dba-9c26e3750586 None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:21.584620 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 342/683] 10.222.0.18 () {56 vars in 1251 bytes} [Sat Sep 24 19:22:21 2022] GET /identity/v3/endpoints?service_id=2356c836f6eb46cf8f1b5b7c0ba53fd7&interface=public®ion_id=RegionOne => generated 194 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:22:21.591411 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f88107d-cb0a-4402-8399-0d85e3958989 None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:21.716646 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f88107d-cb0a-4402-8399-0d85e3958989 None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:21.753388 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008805ef-bd11-49bc-8aec-83a652d92c8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:21.754380 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008805ef-bd11-49bc-8aec-83a652d92c8d None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:21.754864 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008805ef-bd11-49bc-8aec-83a652d92c8d None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:21.755353 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008805ef-bd11-49bc-8aec-83a652d92c8d None admin] PATH_INFO: `/v3/services` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:21.756264 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008805ef-bd11-49bc-8aec-83a652d92c8d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:21.757940 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008805ef-bd11-49bc-8aec-83a652d92c8d None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:21.766835 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 342/684] 10.222.0.18 () {56 vars in 1087 bytes} [Sat Sep 24 19:22:21 2022] GET /identity/v3/services => generated 1002 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 19:22:22.876423 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745c9d3f-676e-4f41-a4c7-596f2d553a56 None None] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:22.877607 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745c9d3f-676e-4f41-a4c7-596f2d553a56 None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:22.878163 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745c9d3f-676e-4f41-a4c7-596f2d553a56 None None] PATH_INFO: `/` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:22.880262 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 343/685] 10.222.0.18 () {54 vars in 927 bytes} [Sat Sep 24 19:22:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:22:22.886514 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b3549d-69d7-40b0-baa7-9f89b3f13db0 None None] REQUEST_METHOD: `POST` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:22.887553 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b3549d-69d7-40b0-baa7-9f89b3f13db0 None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:22.888641 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b3549d-69d7-40b0-baa7-9f89b3f13db0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:22.907694 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.auth.core [None req-45b3549d-69d7-40b0-baa7-9f89b3f13db0 None None] MFA Rules not processed for user `3dbbb9909cec43ff99c1c3682f016ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=88080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:22:22.909234 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.fernet_utils [None req-45b3549d-69d7-40b0-baa7-9f89b3f13db0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:22:22.957623 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:22:22.986719 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 343/686] 10.222.0.18 () {58 vars in 1024 bytes} [Sat Sep 24 19:22:22 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 19:22:23.038510 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af172119-812a-4ac9-a195-3c5aba378e5d None None] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:23.038707 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af172119-812a-4ac9-a195-3c5aba378e5d None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:23.038971 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af172119-812a-4ac9-a195-3c5aba378e5d None None] PATH_INFO: `/` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:23.040560 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 344/687] 10.222.0.18 () {54 vars in 927 bytes} [Sat Sep 24 19:22:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:22:23.047423 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9e4e30-4ff0-4e3f-b57e-fe1c17c0996a None None] REQUEST_METHOD: `POST` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:23.047863 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9e4e30-4ff0-4e3f-b57e-fe1c17c0996a None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:23.048141 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9e4e30-4ff0-4e3f-b57e-fe1c17c0996a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:23.068763 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.auth.core [None req-7c9e4e30-4ff0-4e3f-b57e-fe1c17c0996a None None] MFA Rules not processed for user `3dbbb9909cec43ff99c1c3682f016ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=88080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:22:23.069993 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.fernet_utils [None req-7c9e4e30-4ff0-4e3f-b57e-fe1c17c0996a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:22:23.140311 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 344/688] 10.222.0.18 () {58 vars in 1024 bytes} [Sat Sep 24 19:22:23 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 19:22:23.320939 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af172119-812a-4ac9-a195-3c5aba378e5d None None] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:23.333004 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa94f13-d209-4781-a1d1-f0b3ed0bd4a1 None None] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:23.333304 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa94f13-d209-4781-a1d1-f0b3ed0bd4a1 None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:23.333544 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa94f13-d209-4781-a1d1-f0b3ed0bd4a1 None None] PATH_INFO: `/` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:23.335159 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 345/689] 10.222.0.18 () {54 vars in 927 bytes} [Sat Sep 24 19:22:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:22:23.340240 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34749355-bb81-4ea4-ad8d-11e6e25d6fcc None None] REQUEST_METHOD: `POST` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:23.341301 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34749355-bb81-4ea4-ad8d-11e6e25d6fcc None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:23.341779 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34749355-bb81-4ea4-ad8d-11e6e25d6fcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:23.362785 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.auth.core [None req-34749355-bb81-4ea4-ad8d-11e6e25d6fcc None None] MFA Rules not processed for user `3dbbb9909cec43ff99c1c3682f016ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=88080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:22:23.364971 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.fernet_utils [None req-34749355-bb81-4ea4-ad8d-11e6e25d6fcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:22:23.418200 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:22:23.440508 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af172119-812a-4ac9-a195-3c5aba378e5d None None] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:23.442476 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 346/690] 10.222.0.18 () {58 vars in 1024 bytes} [Sat Sep 24 19:22:23 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 24 19:22:23.477048 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34749355-bb81-4ea4-ad8d-11e6e25d6fcc None None] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:23.489740 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e80b64a-bc85-40aa-b72f-d949789be65d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:23.490534 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e80b64a-bc85-40aa-b72f-d949789be65d None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:23.490813 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e80b64a-bc85-40aa-b72f-d949789be65d None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:23.491084 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e80b64a-bc85-40aa-b72f-d949789be65d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:23.508493 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e80b64a-bc85-40aa-b72f-d949789be65d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:22:23.520852 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application [None req-6e80b64a-bc85-40aa-b72f-d949789be65d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 19:22:23.520852 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:22:23.520852 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:22:23.520852 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:22:23.520852 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:22:23.520852 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:22:23.520852 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:22:23.520852 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:22:23.520852 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:22:23.520852 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:22:23.520852 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:22:23.520852 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:22:23.520852 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:22:23.520852 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:22:23.520852 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:22:23.520852 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:22:23.521960 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:22:23.521960 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:22:23.521960 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:22:23.521960 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:22:23.521960 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:22:23.521960 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:22:23.521960 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:22:23.521960 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:22:23.521960 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:22:23.521960 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:22:23.521960 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:22:23.521960 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application with Lock( Sep 24 19:22:23.521960 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:22:23.521960 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:22:23.521960 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:22:23.521960 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:22:23.522933 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:22:23.522933 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:22:23.522933 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:22:23.522933 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:22:23.522933 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:22:23.522933 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:22:23.522933 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:22:23.522933 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:22:23.522933 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:22:23.522933 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:22:23.522933 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 19:22:23.522933 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Sep 24 19:22:23.522933 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 345/691] 10.222.0.18 () {56 vars in 1096 bytes} [Sat Sep 24 19:22:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:22:23.525525 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e80b64a-bc85-40aa-b72f-d949789be65d None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:23.550203 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:22:23.655269 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34749355-bb81-4ea4-ad8d-11e6e25d6fcc None None] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:23.657262 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e80b64a-bc85-40aa-b72f-d949789be65d None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:23.699207 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae58d75-7382-4cfe-bc94-e317c95a1157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:23.700032 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae58d75-7382-4cfe-bc94-e317c95a1157 None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:23.700946 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae58d75-7382-4cfe-bc94-e317c95a1157 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:23.701279 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae58d75-7382-4cfe-bc94-e317c95a1157 None admin] PATH_INFO: `/v3/roles` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:23.702069 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae58d75-7382-4cfe-bc94-e317c95a1157 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:22:23.702435 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae58d75-7382-4cfe-bc94-e317c95a1157 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:23.704564 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae58d75-7382-4cfe-bc94-e317c95a1157 None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:23.710459 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104e3671-3fd7-4a67-af85-b59daf2d61f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:23.712086 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104e3671-3fd7-4a67-af85-b59daf2d61f0 None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:23.712617 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104e3671-3fd7-4a67-af85-b59daf2d61f0 None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:23.713364 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104e3671-3fd7-4a67-af85-b59daf2d61f0 None admin] PATH_INFO: `/v3/services/network` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:23.714138 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104e3671-3fd7-4a67-af85-b59daf2d61f0 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:23.715505 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 346/692] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Sep 24 19:22:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:22:23.715885 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104e3671-3fd7-4a67-af85-b59daf2d61f0 None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:23.725891 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae58d75-7382-4cfe-bc94-e317c95a1157 None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:23.726096 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application [None req-104e3671-3fd7-4a67-af85-b59daf2d61f0 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 24 19:22:23.726096 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:22:23.726096 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 24 19:22:23.726096 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 24 19:22:23.726096 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 24 19:22:23.726096 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 24 19:22:23.726096 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 24 19:22:23.726096 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 19:22:23.726096 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 24 19:22:23.726096 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Sep 24 19:22:23.726096 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 24 19:22:23.726096 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Sep 24 19:22:23.726096 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:22:23.726096 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:22:23.726096 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:22:23.726096 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:22:23.726096 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:22:23.727286 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:22:23.727286 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:22:23.727286 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:22:23.727286 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:22:23.727286 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:22:23.727286 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:22:23.727286 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 24 19:22:23.727286 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 24 19:22:23.727286 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 24 19:22:23.727286 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 24 19:22:23.727286 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:22:23.727286 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:22:23.727286 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:22:23.727286 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:22:23.727286 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:22:23.727286 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:22:23.728188 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:22:23.728188 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application with Lock( Sep 24 19:22:23.728188 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:22:23.728188 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:22:23.728188 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:22:23.728188 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:22:23.728188 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:22:23.728188 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:22:23.728188 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:22:23.728188 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:22:23.728188 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 24 19:22:23.728188 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 19:22:23.728188 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 24 19:22:23.728188 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Sep 24 19:22:23.731890 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 347/693] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Sep 24 19:22:23 2022] GET /identity/v3/services/network => generated 88 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 19:22:23.734153 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104e3671-3fd7-4a67-af85-b59daf2d61f0 None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:23.739377 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:22:23.851467 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae58d75-7382-4cfe-bc94-e317c95a1157 None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:23.865998 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104e3671-3fd7-4a67-af85-b59daf2d61f0 None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:23.869135 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:22:23.892940 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ac02c2-869a-4df2-8000-bb7a57a48cce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:23.893609 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ac02c2-869a-4df2-8000-bb7a57a48cce None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:23.893968 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ac02c2-869a-4df2-8000-bb7a57a48cce None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:23.894177 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ac02c2-869a-4df2-8000-bb7a57a48cce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:23.906277 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67711c5-39da-4ddc-80be-7a3ff69a3e9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:23.906783 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67711c5-39da-4ddc-80be-7a3ff69a3e9e None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:23.907060 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67711c5-39da-4ddc-80be-7a3ff69a3e9e None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:23.907326 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67711c5-39da-4ddc-80be-7a3ff69a3e9e None admin] PATH_INFO: `/v3/services` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:23.907951 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67711c5-39da-4ddc-80be-7a3ff69a3e9e None admin] RBAC: Adding query filter params (name=network) {{(pid=88080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:22:23.908248 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67711c5-39da-4ddc-80be-7a3ff69a3e9e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:23.908755 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ac02c2-869a-4df2-8000-bb7a57a48cce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:23.909602 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67711c5-39da-4ddc-80be-7a3ff69a3e9e None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:23.910815 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ac02c2-869a-4df2-8000-bb7a57a48cce None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:23.918161 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 348/694] 10.222.0.18 () {56 vars in 1112 bytes} [Sat Sep 24 19:22:23 2022] GET /identity/v3/services?name=network => generated 124 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:22:23.919155 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67711c5-39da-4ddc-80be-7a3ff69a3e9e None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:23.927655 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application [None req-07ac02c2-869a-4df2-8000-bb7a57a48cce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:22:23.927655 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:22:23.927655 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:22:23.927655 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:22:23.927655 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:22:23.927655 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:22:23.927655 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:22:23.927655 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:22:23.927655 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:22:23.927655 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:22:23.927655 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:22:23.927655 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:22:23.927655 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:22:23.927655 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:22:23.927655 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:22:23.927655 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:22:23.928639 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:22:23.928639 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:22:23.928639 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:22:23.928639 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:22:23.928639 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:22:23.928639 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:22:23.928639 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:22:23.928639 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application with Lock( Sep 24 19:22:23.928639 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:22:23.928639 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:22:23.928639 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:22:23.928639 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:22:23.928639 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:22:23.928639 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:22:23.928639 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:22:23.928639 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:22:23.928639 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:22:23.929521 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:22:23.929521 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:22:23.929521 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Sep 24 19:22:23.933618 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 347/695] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Sep 24 19:22:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:22:23.934555 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ac02c2-869a-4df2-8000-bb7a57a48cce None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:23.999929 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:22:24.035163 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67711c5-39da-4ddc-80be-7a3ff69a3e9e None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:24.045711 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ac02c2-869a-4df2-8000-bb7a57a48cce None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:24.072046 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9e4672-5365-4431-b48a-bc6f0a6812b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:24.072678 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9e4672-5365-4431-b48a-bc6f0a6812b6 None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:24.072989 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9e4672-5365-4431-b48a-bc6f0a6812b6 None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:24.073233 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9e4672-5365-4431-b48a-bc6f0a6812b6 None admin] PATH_INFO: `/v3/services/image` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:24.073954 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9e4672-5365-4431-b48a-bc6f0a6812b6 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:24.076004 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9e4672-5365-4431-b48a-bc6f0a6812b6 None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:24.082649 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa04a5e7-f1d0-4659-90af-a648de8d5537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:24.083223 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa04a5e7-f1d0-4659-90af-a648de8d5537 None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:24.083490 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa04a5e7-f1d0-4659-90af-a648de8d5537 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:24.083748 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa04a5e7-f1d0-4659-90af-a648de8d5537 None admin] PATH_INFO: `/v3/services` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:24.084365 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa04a5e7-f1d0-4659-90af-a648de8d5537 None admin] RBAC: Adding query filter params (type=network) {{(pid=88081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:22:24.084656 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa04a5e7-f1d0-4659-90af-a648de8d5537 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:24.085801 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application [None req-dc9e4672-5365-4431-b48a-bc6f0a6812b6 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 24 19:22:24.085801 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:22:24.085801 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 24 19:22:24.085801 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 24 19:22:24.085801 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 24 19:22:24.085801 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 24 19:22:24.085801 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 24 19:22:24.085801 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 19:22:24.085801 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 24 19:22:24.085801 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Sep 24 19:22:24.085801 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 24 19:22:24.085801 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Sep 24 19:22:24.085801 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:22:24.085801 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:22:24.085801 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:22:24.085801 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:22:24.085801 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:22:24.090166 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:22:24.090166 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:22:24.090166 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:22:24.090166 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:22:24.090166 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:22:24.090166 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:22:24.090166 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 24 19:22:24.090166 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 24 19:22:24.090166 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 24 19:22:24.090166 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 24 19:22:24.090166 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:22:24.090166 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:22:24.090166 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:22:24.090166 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:22:24.090166 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:22:24.090166 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:22:24.091649 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:22:24.091649 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application with Lock( Sep 24 19:22:24.091649 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:22:24.091649 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:22:24.091649 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:22:24.091649 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:22:24.091649 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:22:24.091649 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:22:24.091649 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:22:24.091649 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:22:24.091649 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 24 19:22:24.091649 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 19:22:24.091649 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 24 19:22:24.091649 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Sep 24 19:22:24.092405 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa04a5e7-f1d0-4659-90af-a648de8d5537 None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:24.092487 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 349/696] 10.222.0.18 () {56 vars in 1105 bytes} [Sat Sep 24 19:22:23 2022] GET /identity/v3/services/image => generated 86 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:22:24.092487 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9e4672-5365-4431-b48a-bc6f0a6812b6 None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:24.095537 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 348/697] 10.222.0.18 () {56 vars in 1112 bytes} [Sat Sep 24 19:22:23 2022] GET /identity/v3/services?type=network => generated 350 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:22:24.101036 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa04a5e7-f1d0-4659-90af-a648de8d5537 None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:24.127968 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:22:24.209245 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9e4672-5365-4431-b48a-bc6f0a6812b6 None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:24.249434 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79180ac-74e1-403a-b194-039e9b3c0e0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:24.250278 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79180ac-74e1-403a-b194-039e9b3c0e0b None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:24.250618 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79180ac-74e1-403a-b194-039e9b3c0e0b None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:24.250924 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79180ac-74e1-403a-b194-039e9b3c0e0b None admin] PATH_INFO: `/v3/domains` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:24.251914 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79180ac-74e1-403a-b194-039e9b3c0e0b None admin] RBAC: Adding query filter params (name=Default) {{(pid=88080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:22:24.252238 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79180ac-74e1-403a-b194-039e9b3c0e0b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:24.253864 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79180ac-74e1-403a-b194-039e9b3c0e0b None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:24.255858 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa04a5e7-f1d0-4659-90af-a648de8d5537 None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:24.272606 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 350/698] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Sep 24 19:22:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:22:24.272606 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79180ac-74e1-403a-b194-039e9b3c0e0b None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:24.299109 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:22:24.314465 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0045ef0b-a437-4192-88de-dbffaedf07ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:24.315073 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0045ef0b-a437-4192-88de-dbffaedf07ec None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:24.315345 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0045ef0b-a437-4192-88de-dbffaedf07ec None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:24.315613 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0045ef0b-a437-4192-88de-dbffaedf07ec None admin] PATH_INFO: `/v3/services` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:24.316241 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0045ef0b-a437-4192-88de-dbffaedf07ec None admin] RBAC: Adding query filter params (name=image) {{(pid=88081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:22:24.316538 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0045ef0b-a437-4192-88de-dbffaedf07ec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:24.318401 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0045ef0b-a437-4192-88de-dbffaedf07ec None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:24.325306 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 349/699] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Sep 24 19:22:24 2022] GET /identity/v3/services?name=image => generated 122 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:22:24.326160 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0045ef0b-a437-4192-88de-dbffaedf07ec None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:24.386501 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:22:24.397201 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79180ac-74e1-403a-b194-039e9b3c0e0b None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:24.427817 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0045ef0b-a437-4192-88de-dbffaedf07ec None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:24.431531 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8513d3ea-a955-4669-b79d-d6e29756be1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:24.432138 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8513d3ea-a955-4669-b79d-d6e29756be1d None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:24.432429 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8513d3ea-a955-4669-b79d-d6e29756be1d None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:24.432698 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8513d3ea-a955-4669-b79d-d6e29756be1d None admin] PATH_INFO: `/v3/endpoints` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:24.433419 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8513d3ea-a955-4669-b79d-d6e29756be1d None admin] RBAC: Adding query filter params (interface=public, service_id=64564e09583b4823a5aeb124f343b320, region_id=RegionOne) {{(pid=88080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:22:24.433721 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8513d3ea-a955-4669-b79d-d6e29756be1d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:24.435191 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8513d3ea-a955-4669-b79d-d6e29756be1d None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:24.442578 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 351/700] 10.222.0.18 () {56 vars in 1251 bytes} [Sat Sep 24 19:22:24 2022] GET /identity/v3/endpoints?service_id=64564e09583b4823a5aeb124f343b320&interface=public®ion_id=RegionOne => generated 194 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:22:24.443895 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d312f21-4fd9-44b9-93ea-413ac6ede885 None None] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:24.444204 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d312f21-4fd9-44b9-93ea-413ac6ede885 None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:24.444448 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d312f21-4fd9-44b9-93ea-413ac6ede885 None None] PATH_INFO: `/` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:24.445646 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 352/701] 10.222.0.18 () {54 vars in 927 bytes} [Sat Sep 24 19:22:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:22:24.451675 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d312f21-4fd9-44b9-93ea-413ac6ede885 None None] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:24.467423 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce4201f-5be6-4962-8bbf-0a8ee2993759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:24.468056 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce4201f-5be6-4962-8bbf-0a8ee2993759 None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:24.468373 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce4201f-5be6-4962-8bbf-0a8ee2993759 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:24.468665 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce4201f-5be6-4962-8bbf-0a8ee2993759 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:24.477147 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce4201f-5be6-4962-8bbf-0a8ee2993759 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:24.478643 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce4201f-5be6-4962-8bbf-0a8ee2993759 None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:24.491396 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application [None req-9ce4201f-5be6-4962-8bbf-0a8ee2993759 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 24 19:22:24.491396 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:22:24.491396 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:22:24.491396 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:22:24.491396 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:22:24.491396 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:22:24.491396 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:22:24.491396 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:22:24.491396 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:22:24.491396 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:22:24.491396 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:22:24.491396 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:22:24.491396 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 24 19:22:24.491396 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 24 19:22:24.491396 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 24 19:22:24.491396 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 24 19:22:24.492813 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:22:24.492813 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:22:24.492813 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 24 19:22:24.492813 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 19:22:24.492813 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 24 19:22:24.492813 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 19:22:24.492813 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:22:24.492813 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:22:24.492813 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:22:24.492813 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:22:24.492813 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:22:24.492813 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application with Lock( Sep 24 19:22:24.492813 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:22:24.492813 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:22:24.492813 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:22:24.492813 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:22:24.492813 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:22:24.492813 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:22:24.493948 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:22:24.493948 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:22:24.493948 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 24 19:22:24.493948 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 24 19:22:24.493948 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 24 19:22:24.493948 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 24 19:22:24.493948 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 24 19:22:24.493948 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 24 19:22:24.493948 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 24 19:22:24.493948 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Sep 24 19:22:24.493948 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 350/702] 10.222.0.18 () {56 vars in 1093 bytes} [Sat Sep 24 19:22:24 2022] GET /identity/v3/users/nova => generated 82 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:22:24.493948 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce4201f-5be6-4962-8bbf-0a8ee2993759 None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:24.542881 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:22:24.560043 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d312f21-4fd9-44b9-93ea-413ac6ede885 None None] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:24.598888 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48b1038-6091-4c34-948b-912162673ed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:24.599485 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48b1038-6091-4c34-948b-912162673ed9 None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:24.599758 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48b1038-6091-4c34-948b-912162673ed9 None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:24.600027 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48b1038-6091-4c34-948b-912162673ed9 None admin] PATH_INFO: `/v3/services` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:24.600540 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce4201f-5be6-4962-8bbf-0a8ee2993759 None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:24.600654 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48b1038-6091-4c34-948b-912162673ed9 None admin] RBAC: Adding query filter params (type=image) {{(pid=88080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:22:24.600935 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48b1038-6091-4c34-948b-912162673ed9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:24.602355 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48b1038-6091-4c34-948b-912162673ed9 None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:24.607303 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 353/703] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Sep 24 19:22:24 2022] GET /identity/v3/services?type=image => generated 350 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:22:24.613624 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad80900b-fd28-4434-a24e-a431833c366f None None] REQUEST_METHOD: `POST` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:24.613624 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad80900b-fd28-4434-a24e-a431833c366f None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:24.613624 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad80900b-fd28-4434-a24e-a431833c366f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:24.628731 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.auth.core [None req-ad80900b-fd28-4434-a24e-a431833c366f None None] MFA Rules not processed for user `3dbbb9909cec43ff99c1c3682f016ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=88080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:22:24.629949 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.fernet_utils [None req-ad80900b-fd28-4434-a24e-a431833c366f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:22:24.640744 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a509fa63-190a-4e8c-a7d7-c40edae5585a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:24.641348 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a509fa63-190a-4e8c-a7d7-c40edae5585a None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:24.641626 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a509fa63-190a-4e8c-a7d7-c40edae5585a None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:24.641930 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a509fa63-190a-4e8c-a7d7-c40edae5585a None admin] PATH_INFO: `/v3/services` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:24.642532 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a509fa63-190a-4e8c-a7d7-c40edae5585a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:24.643894 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a509fa63-190a-4e8c-a7d7-c40edae5585a None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:24.645464 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:22:24.649705 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 351/704] 10.222.0.18 () {56 vars in 1087 bytes} [Sat Sep 24 19:22:24 2022] GET /identity/v3/services => generated 1002 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 19:22:24.650546 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a509fa63-190a-4e8c-a7d7-c40edae5585a None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:24.717268 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 354/705] 10.222.0.18 () {58 vars in 1024 bytes} [Sat Sep 24 19:22:24 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 19:22:24.718734 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad80900b-fd28-4434-a24e-a431833c366f None None] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:24.813709 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a509fa63-190a-4e8c-a7d7-c40edae5585a None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:24.830056 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:22:24.858420 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2e4132-aef3-474e-9244-e0ac55aac905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:24.859207 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2e4132-aef3-474e-9244-e0ac55aac905 None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:24.859599 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2e4132-aef3-474e-9244-e0ac55aac905 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:24.859964 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2e4132-aef3-474e-9244-e0ac55aac905 None admin] PATH_INFO: `/v3/users` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:24.860792 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2e4132-aef3-474e-9244-e0ac55aac905 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:22:24.861194 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2e4132-aef3-474e-9244-e0ac55aac905 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:24.862967 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2e4132-aef3-474e-9244-e0ac55aac905 None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:24.876309 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad80900b-fd28-4434-a24e-a431833c366f None None] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:24.891740 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 352/706] 10.222.0.18 () {56 vars in 1133 bytes} [Sat Sep 24 19:22:24 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:22:24.896707 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2e4132-aef3-474e-9244-e0ac55aac905 None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:24.927884 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4d406a-ebae-42da-be0c-e68ff42f1b0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:24.928722 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4d406a-ebae-42da-be0c-e68ff42f1b0a None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:24.928857 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4d406a-ebae-42da-be0c-e68ff42f1b0a None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:24.929214 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4d406a-ebae-42da-be0c-e68ff42f1b0a None admin] PATH_INFO: `/v3/endpoints` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:24.929965 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4d406a-ebae-42da-be0c-e68ff42f1b0a None admin] RBAC: Adding query filter params (interface=public, service_id=2a38caa1f43a4209b724ae9f80fce2b1, region_id=RegionOne) {{(pid=88080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:22:24.930275 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4d406a-ebae-42da-be0c-e68ff42f1b0a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:24.932273 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4d406a-ebae-42da-be0c-e68ff42f1b0a None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:24.939738 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 355/707] 10.222.0.18 () {56 vars in 1251 bytes} [Sat Sep 24 19:22:24 2022] GET /identity/v3/endpoints?service_id=2a38caa1f43a4209b724ae9f80fce2b1&interface=public®ion_id=RegionOne => generated 194 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:22:24.945354 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4d406a-ebae-42da-be0c-e68ff42f1b0a None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:24.967072 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:22:25.035881 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2e4132-aef3-474e-9244-e0ac55aac905 None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:25.083719 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4d406a-ebae-42da-be0c-e68ff42f1b0a None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:25.129937 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3d7cc2-0c17-4b55-b691-e5ba939dff5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:25.130548 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3d7cc2-0c17-4b55-b691-e5ba939dff5d None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:25.130818 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3d7cc2-0c17-4b55-b691-e5ba939dff5d None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:25.131083 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3d7cc2-0c17-4b55-b691-e5ba939dff5d None admin] PATH_INFO: `/v3/services` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:25.131698 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3d7cc2-0c17-4b55-b691-e5ba939dff5d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:25.133093 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3d7cc2-0c17-4b55-b691-e5ba939dff5d None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:25.140219 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 356/708] 10.222.0.18 () {56 vars in 1087 bytes} [Sat Sep 24 19:22:24 2022] GET /identity/v3/services => generated 1002 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 24 19:22:25.142894 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3d7cc2-0c17-4b55-b691-e5ba939dff5d None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:25.251719 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4be3010-b5e2-4f38-990a-424cbb3be32f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:25.252608 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4be3010-b5e2-4f38-990a-424cbb3be32f None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:25.253477 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4be3010-b5e2-4f38-990a-424cbb3be32f None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:25.253979 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4be3010-b5e2-4f38-990a-424cbb3be32f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:25.268033 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:22:25.282868 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4be3010-b5e2-4f38-990a-424cbb3be32f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:25.286799 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4be3010-b5e2-4f38-990a-424cbb3be32f None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:25.309995 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3d7cc2-0c17-4b55-b691-e5ba939dff5d None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:25.312390 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application [None req-f4be3010-b5e2-4f38-990a-424cbb3be32f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:22:25.312390 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:22:25.312390 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:22:25.312390 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:22:25.312390 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:22:25.312390 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:22:25.312390 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:22:25.312390 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:22:25.312390 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:22:25.312390 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:22:25.312390 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:22:25.312390 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:22:25.312390 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:22:25.312390 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:22:25.312390 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:22:25.312390 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:22:25.313374 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:22:25.313374 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:22:25.313374 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:22:25.313374 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:22:25.313374 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:22:25.313374 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:22:25.313374 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:22:25.313374 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application with Lock( Sep 24 19:22:25.313374 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:22:25.313374 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:22:25.313374 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:22:25.313374 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:22:25.313374 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:22:25.313374 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:22:25.313374 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:22:25.313374 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:22:25.313374 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:22:25.314336 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:22:25.314336 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:22:25.314336 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Sep 24 19:22:25.322038 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 353/709] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Sep 24 19:22:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 426 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 19:22:25.323653 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4be3010-b5e2-4f38-990a-424cbb3be32f None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:25.355102 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:22:25.365487 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc593bb1-38af-4348-9b26-5924603a1da0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:25.366584 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc593bb1-38af-4348-9b26-5924603a1da0 None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:25.367165 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc593bb1-38af-4348-9b26-5924603a1da0 None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:25.367687 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc593bb1-38af-4348-9b26-5924603a1da0 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:25.368589 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc593bb1-38af-4348-9b26-5924603a1da0 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:25.370332 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc593bb1-38af-4348-9b26-5924603a1da0 None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:25.380940 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application [None req-dc593bb1-38af-4348-9b26-5924603a1da0 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 24 19:22:25.380940 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:22:25.380940 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 24 19:22:25.380940 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 24 19:22:25.380940 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 24 19:22:25.380940 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 24 19:22:25.380940 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 24 19:22:25.380940 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 19:22:25.380940 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 24 19:22:25.380940 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Sep 24 19:22:25.380940 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 24 19:22:25.380940 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Sep 24 19:22:25.380940 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:22:25.380940 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:22:25.380940 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:22:25.380940 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:22:25.380940 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:22:25.382021 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:22:25.382021 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:22:25.382021 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:22:25.382021 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:22:25.382021 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:22:25.382021 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:22:25.382021 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 24 19:22:25.382021 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 24 19:22:25.382021 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 24 19:22:25.382021 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 24 19:22:25.382021 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:22:25.382021 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:22:25.382021 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:22:25.382021 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:22:25.382021 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:22:25.382021 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:22:25.382863 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:22:25.382863 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application with Lock( Sep 24 19:22:25.382863 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:22:25.382863 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:22:25.382863 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:22:25.382863 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:22:25.382863 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:22:25.382863 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:22:25.382863 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:22:25.382863 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:22:25.382863 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 24 19:22:25.382863 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 19:22:25.382863 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 24 19:22:25.382863 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Sep 24 19:22:25.383605 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 357/710] 10.222.0.18 () {56 vars in 1129 bytes} [Sat Sep 24 19:22:25 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:22:25.391037 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc593bb1-38af-4348-9b26-5924603a1da0 None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:25.464082 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4be3010-b5e2-4f38-990a-424cbb3be32f None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:25.513132 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b393cc99-2b60-4413-b401-3bbb78183c3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:25.513942 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b393cc99-2b60-4413-b401-3bbb78183c3a None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:25.514241 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b393cc99-2b60-4413-b401-3bbb78183c3a None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:25.514547 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b393cc99-2b60-4413-b401-3bbb78183c3a None admin] PATH_INFO: `/v3/domains` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:25.515255 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b393cc99-2b60-4413-b401-3bbb78183c3a None admin] RBAC: Adding query filter params (name=Default) {{(pid=88081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:22:25.515594 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b393cc99-2b60-4413-b401-3bbb78183c3a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:25.517994 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b393cc99-2b60-4413-b401-3bbb78183c3a None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:25.521555 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc593bb1-38af-4348-9b26-5924603a1da0 None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:25.541491 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 354/711] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Sep 24 19:22:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:22:25.542219 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b393cc99-2b60-4413-b401-3bbb78183c3a None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:25.565974 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86acf0e-2926-4444-a429-ca096e756c39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:25.566838 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86acf0e-2926-4444-a429-ca096e756c39 None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:25.567268 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86acf0e-2926-4444-a429-ca096e756c39 None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:25.567710 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86acf0e-2926-4444-a429-ca096e756c39 None admin] PATH_INFO: `/v3/services` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:25.568504 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86acf0e-2926-4444-a429-ca096e756c39 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=88080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:22:25.568955 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86acf0e-2926-4444-a429-ca096e756c39 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:25.570546 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86acf0e-2926-4444-a429-ca096e756c39 None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:25.576108 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 358/712] 10.222.0.18 () {56 vars in 1124 bytes} [Sat Sep 24 19:22:25 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:22:25.585983 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86acf0e-2926-4444-a429-ca096e756c39 None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:25.611364 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:22:25.646086 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:22:25.669872 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b393cc99-2b60-4413-b401-3bbb78183c3a None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:25.712120 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08801965-e620-4052-9b1c-be52ed35ff0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:25.712546 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08801965-e620-4052-9b1c-be52ed35ff0d None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:25.712937 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08801965-e620-4052-9b1c-be52ed35ff0d None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:25.713127 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08801965-e620-4052-9b1c-be52ed35ff0d None admin] PATH_INFO: `/v3/projects/service` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:25.725296 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08801965-e620-4052-9b1c-be52ed35ff0d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:25.726056 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86acf0e-2926-4444-a429-ca096e756c39 None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:25.727963 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08801965-e620-4052-9b1c-be52ed35ff0d None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:25.744979 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application [None req-08801965-e620-4052-9b1c-be52ed35ff0d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 19:22:25.744979 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:22:25.744979 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:22:25.744979 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:22:25.744979 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:22:25.744979 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:22:25.744979 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:22:25.744979 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:22:25.744979 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:22:25.744979 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:22:25.744979 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:22:25.744979 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:22:25.744979 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 24 19:22:25.744979 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 24 19:22:25.744979 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 24 19:22:25.746381 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 24 19:22:25.746381 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:22:25.746381 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:22:25.746381 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:22:25.746381 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:22:25.746381 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:22:25.746381 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:22:25.746381 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:22:25.746381 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application with Lock( Sep 24 19:22:25.746381 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:22:25.746381 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:22:25.746381 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:22:25.746381 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:22:25.746381 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:22:25.746381 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:22:25.746381 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:22:25.746381 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:22:25.747844 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 24 19:22:25.747844 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 24 19:22:25.747844 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 24 19:22:25.747844 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 24 19:22:25.747844 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 24 19:22:25.747844 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 24 19:22:25.747844 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 19:22:25.747844 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Sep 24 19:22:25.750463 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 355/713] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Sep 24 19:22:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:22:25.755798 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08801965-e620-4052-9b1c-be52ed35ff0d None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:25.775059 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71c81e4-8d62-4f2b-9d1a-14725db76201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:25.775676 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71c81e4-8d62-4f2b-9d1a-14725db76201 None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:25.776000 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71c81e4-8d62-4f2b-9d1a-14725db76201 None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:25.776275 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71c81e4-8d62-4f2b-9d1a-14725db76201 None admin] PATH_INFO: `/v3/services` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:25.776914 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71c81e4-8d62-4f2b-9d1a-14725db76201 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=88080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:22:25.777213 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71c81e4-8d62-4f2b-9d1a-14725db76201 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:25.778814 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71c81e4-8d62-4f2b-9d1a-14725db76201 None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:25.789468 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 359/714] 10.222.0.18 () {56 vars in 1124 bytes} [Sat Sep 24 19:22:25 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:22:25.790778 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71c81e4-8d62-4f2b-9d1a-14725db76201 None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:25.880304 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:22:25.913785 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08801965-e620-4052-9b1c-be52ed35ff0d None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:25.937774 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71c81e4-8d62-4f2b-9d1a-14725db76201 None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:25.962045 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cdc8d6-ebb9-42f2-98d2-7d97b297a589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:25.963059 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cdc8d6-ebb9-42f2-98d2-7d97b297a589 None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:25.963559 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cdc8d6-ebb9-42f2-98d2-7d97b297a589 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:25.964035 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cdc8d6-ebb9-42f2-98d2-7d97b297a589 None admin] PATH_INFO: `/v3/projects` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:25.965566 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cdc8d6-ebb9-42f2-98d2-7d97b297a589 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:22:25.966158 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cdc8d6-ebb9-42f2-98d2-7d97b297a589 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:25.968217 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cdc8d6-ebb9-42f2-98d2-7d97b297a589 None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:25.982708 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a70082e-af04-48e4-8fbf-eafae935b384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:25.983096 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:22:25.983501 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a70082e-af04-48e4-8fbf-eafae935b384 None admin] REQUEST_METHOD: `POST` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:25.983796 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a70082e-af04-48e4-8fbf-eafae935b384 None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:25.984058 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a70082e-af04-48e4-8fbf-eafae935b384 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:25.984752 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a70082e-af04-48e4-8fbf-eafae935b384 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:25.986240 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a70082e-af04-48e4-8fbf-eafae935b384 None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:25.989653 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 356/715] 10.222.0.18 () {56 vars in 1148 bytes} [Sat Sep 24 19:22:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:22:25.995890 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cdc8d6-ebb9-42f2-98d2-7d97b297a589 None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:26.021909 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 360/716] 10.222.0.18 () {60 vars in 1144 bytes} [Sat Sep 24 19:22:25 2022] POST /identity/v3/endpoints => generated 346 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:22:26.151039 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cdc8d6-ebb9-42f2-98d2-7d97b297a589 None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:26.206854 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b586f3-cb11-4986-9de7-2ae8e566f7a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:26.207597 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b586f3-cb11-4986-9de7-2ae8e566f7a0 None admin] REQUEST_METHOD: `PUT` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:26.207877 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b586f3-cb11-4986-9de7-2ae8e566f7a0 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:26.208150 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b586f3-cb11-4986-9de7-2ae8e566f7a0 None admin] PATH_INFO: `/v3/projects/9dfa5c2c17244006bdd629ec81553f1a/users/0ab73abe1c6e4b25a17281f4cd8e97e9/roles/4c7d0dafc19b4b0a9821be6ec0da0a8f` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:26.210333 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b586f3-cb11-4986-9de7-2ae8e566f7a0 None admin] RBAC: Authorizing `identity:create_grant(project_id=9dfa5c2c17244006bdd629ec81553f1a, user_id=0ab73abe1c6e4b25a17281f4cd8e97e9, role_id=4c7d0dafc19b4b0a9821be6ec0da0a8f)` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:26.211844 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b586f3-cb11-4986-9de7-2ae8e566f7a0 None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:26.229765 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 357/717] 10.222.0.18 () {58 vars in 1439 bytes} [Sat Sep 24 19:22:25 2022] PUT /identity/v3/projects/9dfa5c2c17244006bdd629ec81553f1a/users/0ab73abe1c6e4b25a17281f4cd8e97e9/roles/4c7d0dafc19b4b0a9821be6ec0da0a8f => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:22:27.164082 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54c1a97-b62b-49e3-950f-7ea90af4fac0 None None] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:27.164640 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54c1a97-b62b-49e3-950f-7ea90af4fac0 None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:27.164640 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54c1a97-b62b-49e3-950f-7ea90af4fac0 None None] PATH_INFO: `/` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:27.166255 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 361/718] 10.222.0.18 () {54 vars in 927 bytes} [Sat Sep 24 19:22:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:22:27.171999 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22149db3-2cde-432d-8671-119101b43dd6 None None] REQUEST_METHOD: `POST` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:27.172397 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22149db3-2cde-432d-8671-119101b43dd6 None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:27.172568 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22149db3-2cde-432d-8671-119101b43dd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:27.191820 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.auth.core [None req-22149db3-2cde-432d-8671-119101b43dd6 None None] MFA Rules not processed for user `3dbbb9909cec43ff99c1c3682f016ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=88081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:22:27.192998 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.fernet_utils [None req-22149db3-2cde-432d-8671-119101b43dd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:22:27.248551 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:22:27.270837 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 358/719] 10.222.0.18 () {58 vars in 1024 bytes} [Sat Sep 24 19:22:27 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 19:22:27.600766 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54c1a97-b62b-49e3-950f-7ea90af4fac0 None None] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:27.711024 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54c1a97-b62b-49e3-950f-7ea90af4fac0 None None] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:27.737807 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:22:27.747598 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fba97ca-3a89-4bcf-b141-ee64c991e904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:27.748226 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fba97ca-3a89-4bcf-b141-ee64c991e904 None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:27.748497 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fba97ca-3a89-4bcf-b141-ee64c991e904 None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:27.748762 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fba97ca-3a89-4bcf-b141-ee64c991e904 None admin] PATH_INFO: `/v3/services/network` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:27.749342 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fba97ca-3a89-4bcf-b141-ee64c991e904 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:27.750717 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fba97ca-3a89-4bcf-b141-ee64c991e904 None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:27.753445 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ad5ec6-34c1-41b5-977c-1a9855d7d397 None None] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:27.753733 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ad5ec6-34c1-41b5-977c-1a9855d7d397 None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:27.754033 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ad5ec6-34c1-41b5-977c-1a9855d7d397 None None] PATH_INFO: `/` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:27.755511 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 359/720] 10.222.0.18 () {54 vars in 927 bytes} [Sat Sep 24 19:22:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:22:27.760156 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application [None req-3fba97ca-3a89-4bcf-b141-ee64c991e904 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 24 19:22:27.760156 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:22:27.760156 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 24 19:22:27.760156 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 24 19:22:27.760156 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 24 19:22:27.760156 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 24 19:22:27.760156 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 24 19:22:27.760156 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 19:22:27.760156 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 24 19:22:27.760156 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Sep 24 19:22:27.760156 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 24 19:22:27.760156 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Sep 24 19:22:27.760156 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:22:27.760156 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:22:27.760156 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:22:27.760156 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:22:27.760156 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:22:27.761075 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:22:27.761075 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:22:27.761075 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:22:27.761075 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:22:27.761075 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:22:27.761075 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:22:27.761075 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 24 19:22:27.761075 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 24 19:22:27.761075 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 24 19:22:27.761075 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 24 19:22:27.761075 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:22:27.761075 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:22:27.761075 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:22:27.761075 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:22:27.761075 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:22:27.761075 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:22:27.762987 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:22:27.762987 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application with Lock( Sep 24 19:22:27.762987 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:22:27.762987 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:22:27.762987 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:22:27.762987 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:22:27.762987 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:22:27.762987 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:22:27.762987 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:22:27.762987 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:22:27.762987 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 24 19:22:27.762987 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 19:22:27.762987 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 24 19:22:27.762987 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Sep 24 19:22:27.762987 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 362/721] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Sep 24 19:22:27 2022] GET /identity/v3/services/network => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:22:27.767607 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc563fcf-69b9-44c5-8c7e-1751fe1243bd None None] REQUEST_METHOD: `POST` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:27.767886 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc563fcf-69b9-44c5-8c7e-1751fe1243bd None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:27.768156 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc563fcf-69b9-44c5-8c7e-1751fe1243bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:27.770735 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fba97ca-3a89-4bcf-b141-ee64c991e904 None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:27.792663 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.auth.core [None req-bc563fcf-69b9-44c5-8c7e-1751fe1243bd None None] MFA Rules not processed for user `3dbbb9909cec43ff99c1c3682f016ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=88081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:22:27.794233 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.fernet_utils [None req-bc563fcf-69b9-44c5-8c7e-1751fe1243bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:22:27.874601 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 360/722] 10.222.0.18 () {58 vars in 1024 bytes} [Sat Sep 24 19:22:27 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 19:22:27.899170 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fba97ca-3a89-4bcf-b141-ee64c991e904 None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:27.938880 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefd0ce7-b5f0-4637-8aac-e975b7f3174d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:27.939479 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefd0ce7-b5f0-4637-8aac-e975b7f3174d None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:27.939752 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefd0ce7-b5f0-4637-8aac-e975b7f3174d None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:27.940018 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefd0ce7-b5f0-4637-8aac-e975b7f3174d None admin] PATH_INFO: `/v3/services` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:27.940647 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefd0ce7-b5f0-4637-8aac-e975b7f3174d None admin] RBAC: Adding query filter params (name=network) {{(pid=88080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:22:27.940942 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefd0ce7-b5f0-4637-8aac-e975b7f3174d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:27.942348 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefd0ce7-b5f0-4637-8aac-e975b7f3174d None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:27.947499 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 363/723] 10.222.0.18 () {56 vars in 1112 bytes} [Sat Sep 24 19:22:27 2022] GET /identity/v3/services?name=network => generated 124 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:22:27.955224 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc563fcf-69b9-44c5-8c7e-1751fe1243bd None None] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:28.067848 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc563fcf-69b9-44c5-8c7e-1751fe1243bd None None] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:28.085292 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:22:28.104762 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f3e141-60c2-4553-b23b-4a955862ba83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:28.105719 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f3e141-60c2-4553-b23b-4a955862ba83 None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:28.106799 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f3e141-60c2-4553-b23b-4a955862ba83 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:28.107303 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f3e141-60c2-4553-b23b-4a955862ba83 None admin] PATH_INFO: `/v3/services` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:28.108124 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f3e141-60c2-4553-b23b-4a955862ba83 None admin] RBAC: Adding query filter params (type=network) {{(pid=88081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:22:28.108637 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f3e141-60c2-4553-b23b-4a955862ba83 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:28.110193 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f3e141-60c2-4553-b23b-4a955862ba83 None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:28.116026 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 361/724] 10.222.0.18 () {56 vars in 1112 bytes} [Sat Sep 24 19:22:27 2022] GET /identity/v3/services?type=network => generated 350 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:22:28.121967 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefd0ce7-b5f0-4637-8aac-e975b7f3174d None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:28.198316 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:22:28.204977 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f3e141-60c2-4553-b23b-4a955862ba83 None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:28.243247 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefd0ce7-b5f0-4637-8aac-e975b7f3174d None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:28.289229 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feee7841-edcf-4e28-bb7a-7268e57c92ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:28.289887 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feee7841-edcf-4e28-bb7a-7268e57c92ee None admin] REQUEST_METHOD: `POST` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:28.290169 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feee7841-edcf-4e28-bb7a-7268e57c92ee None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:28.290439 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feee7841-edcf-4e28-bb7a-7268e57c92ee None admin] PATH_INFO: `/v3/endpoints` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:28.291166 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feee7841-edcf-4e28-bb7a-7268e57c92ee None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:28.292888 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feee7841-edcf-4e28-bb7a-7268e57c92ee None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:28.317890 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 364/725] 10.222.0.18 () {60 vars in 1144 bytes} [Sat Sep 24 19:22:28 2022] POST /identity/v3/endpoints => generated 337 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:22:28.342572 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f3e141-60c2-4553-b23b-4a955862ba83 None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:28.394514 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a9c1ba-b6dd-4c4a-80ef-e922e0aed1a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:28.395578 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a9c1ba-b6dd-4c4a-80ef-e922e0aed1a5 None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:28.396219 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a9c1ba-b6dd-4c4a-80ef-e922e0aed1a5 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:28.396708 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a9c1ba-b6dd-4c4a-80ef-e922e0aed1a5 None admin] PATH_INFO: `/v3/services/image` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:28.397509 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a9c1ba-b6dd-4c4a-80ef-e922e0aed1a5 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:28.399315 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a9c1ba-b6dd-4c4a-80ef-e922e0aed1a5 None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:28.409905 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application [None req-99a9c1ba-b6dd-4c4a-80ef-e922e0aed1a5 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 24 19:22:28.409905 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:22:28.409905 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 24 19:22:28.409905 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 24 19:22:28.409905 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 24 19:22:28.409905 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 24 19:22:28.409905 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 24 19:22:28.409905 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 19:22:28.409905 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 24 19:22:28.409905 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Sep 24 19:22:28.409905 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 24 19:22:28.409905 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Sep 24 19:22:28.409905 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:22:28.409905 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:22:28.409905 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:22:28.409905 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:22:28.409905 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:22:28.410978 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:22:28.410978 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:22:28.410978 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:22:28.410978 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:22:28.410978 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:22:28.410978 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:22:28.410978 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 24 19:22:28.410978 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 24 19:22:28.410978 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 24 19:22:28.410978 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 24 19:22:28.410978 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:22:28.410978 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:22:28.410978 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:22:28.410978 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:22:28.410978 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:22:28.410978 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:22:28.411822 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:22:28.411822 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application with Lock( Sep 24 19:22:28.411822 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:22:28.411822 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:22:28.411822 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:22:28.411822 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:22:28.411822 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:22:28.411822 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:22:28.411822 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:22:28.411822 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:22:28.411822 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 24 19:22:28.411822 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 19:22:28.411822 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 24 19:22:28.411822 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Sep 24 19:22:28.414864 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 362/726] 10.222.0.18 () {56 vars in 1105 bytes} [Sat Sep 24 19:22:28 2022] GET /identity/v3/services/image => generated 86 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 19:22:28.421974 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feee7841-edcf-4e28-bb7a-7268e57c92ee None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:28.545587 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feee7841-edcf-4e28-bb7a-7268e57c92ee None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:28.557619 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:22:28.586010 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7866d9-6dea-47fe-8b00-8cc4a771fdd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:28.586908 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7866d9-6dea-47fe-8b00-8cc4a771fdd7 None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:28.587352 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7866d9-6dea-47fe-8b00-8cc4a771fdd7 None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:28.587762 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7866d9-6dea-47fe-8b00-8cc4a771fdd7 None admin] PATH_INFO: `/v3/services` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:28.588578 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7866d9-6dea-47fe-8b00-8cc4a771fdd7 None admin] RBAC: Adding query filter params (name=image) {{(pid=88080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:22:28.589063 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7866d9-6dea-47fe-8b00-8cc4a771fdd7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:28.591208 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7866d9-6dea-47fe-8b00-8cc4a771fdd7 None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:28.596325 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 365/727] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Sep 24 19:22:28 2022] GET /identity/v3/services?name=image => generated 122 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:22:28.602058 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a9c1ba-b6dd-4c4a-80ef-e922e0aed1a5 None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:28.657316 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:22:28.723850 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a9c1ba-b6dd-4c4a-80ef-e922e0aed1a5 None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:28.733852 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5003e00-2b01-49c9-b643-c31e96aff554 None None] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:28.734139 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5003e00-2b01-49c9-b643-c31e96aff554 None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:28.734407 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5003e00-2b01-49c9-b643-c31e96aff554 None None] PATH_INFO: `/` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:28.735899 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 366/728] 10.222.0.18 () {54 vars in 927 bytes} [Sat Sep 24 19:22:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 24 19:22:28.741091 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cf46a3-ae9e-4dcf-a6b1-e3cd65c1c8ad None None] REQUEST_METHOD: `POST` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:28.741478 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cf46a3-ae9e-4dcf-a6b1-e3cd65c1c8ad None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:28.741814 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cf46a3-ae9e-4dcf-a6b1-e3cd65c1c8ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:28.763025 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.auth.core [None req-86cf46a3-ae9e-4dcf-a6b1-e3cd65c1c8ad None None] MFA Rules not processed for user `3dbbb9909cec43ff99c1c3682f016ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=88080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:22:28.764208 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.fernet_utils [None req-86cf46a3-ae9e-4dcf-a6b1-e3cd65c1c8ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:22:28.765615 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54470159-6962-4a36-abce-fb861188045e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:28.766267 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54470159-6962-4a36-abce-fb861188045e None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:28.766546 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54470159-6962-4a36-abce-fb861188045e None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:28.766809 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54470159-6962-4a36-abce-fb861188045e None admin] PATH_INFO: `/v3/services` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:28.767440 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54470159-6962-4a36-abce-fb861188045e None admin] RBAC: Adding query filter params (type=image) {{(pid=88081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:22:28.767735 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54470159-6962-4a36-abce-fb861188045e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:28.769077 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54470159-6962-4a36-abce-fb861188045e None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:28.778450 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 363/729] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Sep 24 19:22:28 2022] GET /identity/v3/services?type=image => generated 350 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:22:28.784136 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54470159-6962-4a36-abce-fb861188045e None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:28.836290 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 367/730] 10.222.0.18 () {58 vars in 1024 bytes} [Sat Sep 24 19:22:28 2022] POST /identity/v3/auth/tokens => generated 1257 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 19:22:28.837974 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fab6ac-6156-4ec9-9436-72d49a8fed9d None None] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:28.838252 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fab6ac-6156-4ec9-9436-72d49a8fed9d None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:28.838519 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fab6ac-6156-4ec9-9436-72d49a8fed9d None None] PATH_INFO: `/` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:28.840100 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 368/731] 10.222.0.18 () {54 vars in 927 bytes} [Sat Sep 24 19:22:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:22:28.845599 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c2f997-83fc-4ec9-ac1a-dbcf42d0b1da None None] REQUEST_METHOD: `POST` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:28.845935 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c2f997-83fc-4ec9-ac1a-dbcf42d0b1da None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:28.846171 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c2f997-83fc-4ec9-ac1a-dbcf42d0b1da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:28.865437 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.auth.core [None req-c1c2f997-83fc-4ec9-ac1a-dbcf42d0b1da None None] MFA Rules not processed for user `3dbbb9909cec43ff99c1c3682f016ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=88080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:22:28.866648 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.fernet_utils [None req-c1c2f997-83fc-4ec9-ac1a-dbcf42d0b1da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:22:28.896547 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54470159-6962-4a36-abce-fb861188045e None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:28.898996 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:22:28.933521 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319067c5-c875-4479-9ff4-9f84d13ec02b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:28.934708 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319067c5-c875-4479-9ff4-9f84d13ec02b None admin] REQUEST_METHOD: `POST` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:28.935098 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319067c5-c875-4479-9ff4-9f84d13ec02b None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:28.935366 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319067c5-c875-4479-9ff4-9f84d13ec02b None admin] PATH_INFO: `/v3/endpoints` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:28.936145 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319067c5-c875-4479-9ff4-9f84d13ec02b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:28.937494 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319067c5-c875-4479-9ff4-9f84d13ec02b None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:28.944535 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 369/732] 10.222.0.18 () {58 vars in 1024 bytes} [Sat Sep 24 19:22:28 2022] POST /identity/v3/auth/tokens => generated 1257 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 24 19:22:28.963029 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 364/733] 10.222.0.18 () {60 vars in 1144 bytes} [Sat Sep 24 19:22:28 2022] POST /identity/v3/endpoints => generated 327 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 24 19:22:29.167076 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c2f997-83fc-4ec9-ac1a-dbcf42d0b1da None None] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:29.211839 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:22:29.303378 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c2f997-83fc-4ec9-ac1a-dbcf42d0b1da None None] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:29.325496 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319067c5-c875-4479-9ff4-9f84d13ec02b None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:29.351272 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9edfee-936a-4af2-ae2d-b9ffcaa9f2ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:29.351986 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9edfee-936a-4af2-ae2d-b9ffcaa9f2ac None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:29.352310 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9edfee-936a-4af2-ae2d-b9ffcaa9f2ac None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:29.352617 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9edfee-936a-4af2-ae2d-b9ffcaa9f2ac None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:29.353272 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9edfee-936a-4af2-ae2d-b9ffcaa9f2ac None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:29.354951 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9edfee-936a-4af2-ae2d-b9ffcaa9f2ac None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:29.367132 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application [None req-8a9edfee-936a-4af2-ae2d-b9ffcaa9f2ac None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 24 19:22:29.367132 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:22:29.367132 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 24 19:22:29.367132 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 24 19:22:29.367132 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 24 19:22:29.367132 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 24 19:22:29.367132 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 24 19:22:29.367132 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 19:22:29.367132 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 24 19:22:29.367132 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Sep 24 19:22:29.367132 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 24 19:22:29.367132 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Sep 24 19:22:29.367132 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:22:29.367132 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:22:29.367132 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:22:29.367132 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:22:29.367132 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:22:29.368436 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:22:29.368436 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:22:29.368436 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:22:29.368436 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:22:29.368436 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:22:29.368436 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:22:29.368436 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 24 19:22:29.368436 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 24 19:22:29.368436 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 24 19:22:29.368436 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 24 19:22:29.368436 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:22:29.368436 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:22:29.368436 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:22:29.368436 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:22:29.368436 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:22:29.368436 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:22:29.369462 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:22:29.369462 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application with Lock( Sep 24 19:22:29.369462 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:22:29.369462 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:22:29.369462 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:22:29.369462 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:22:29.369462 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:22:29.369462 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:22:29.369462 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:22:29.369462 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:22:29.369462 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 24 19:22:29.369462 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 19:22:29.369462 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 24 19:22:29.369462 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Sep 24 19:22:29.373440 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 370/734] 10.222.0.18 () {56 vars in 1114 bytes} [Sat Sep 24 19:22:29 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:22:29.374847 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9edfee-936a-4af2-ae2d-b9ffcaa9f2ac None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:29.458216 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319067c5-c875-4479-9ff4-9f84d13ec02b None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:29.485216 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:22:29.494408 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9edfee-936a-4af2-ae2d-b9ffcaa9f2ac None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:29.500864 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edc35fb-c98a-4e99-ac26-b348ff68e4c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:29.501507 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edc35fb-c98a-4e99-ac26-b348ff68e4c0 None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:29.501780 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edc35fb-c98a-4e99-ac26-b348ff68e4c0 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:29.502109 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edc35fb-c98a-4e99-ac26-b348ff68e4c0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:29.517206 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edc35fb-c98a-4e99-ac26-b348ff68e4c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:22:29.522530 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application [None req-8edc35fb-c98a-4e99-ac26-b348ff68e4c0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 19:22:29.522530 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:22:29.522530 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:22:29.522530 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:22:29.522530 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:22:29.522530 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:22:29.522530 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:22:29.522530 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:22:29.522530 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:22:29.522530 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:22:29.522530 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:22:29.522530 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:22:29.522530 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:22:29.522530 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:22:29.522530 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:22:29.522530 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:22:29.523828 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:22:29.523828 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:22:29.523828 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:22:29.523828 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:22:29.523828 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:22:29.523828 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:22:29.523828 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:22:29.523828 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:22:29.523828 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:22:29.523828 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:22:29.523828 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:22:29.523828 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application with Lock( Sep 24 19:22:29.523828 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:22:29.523828 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:22:29.523828 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:22:29.523828 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:22:29.524728 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:22:29.524728 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:22:29.524728 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:22:29.524728 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:22:29.524728 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:22:29.524728 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:22:29.524728 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:22:29.524728 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:22:29.524728 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:22:29.524728 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:22:29.524728 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 19:22:29.524728 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Sep 24 19:22:29.528607 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 365/735] 10.222.0.18 () {56 vars in 1096 bytes} [Sat Sep 24 19:22:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 19:22:29.529515 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edc35fb-c98a-4e99-ac26-b348ff68e4c0 None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:29.536479 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d31135-93f8-4c9b-9ea3-b5055117eff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:29.537154 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d31135-93f8-4c9b-9ea3-b5055117eff2 None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:29.537457 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d31135-93f8-4c9b-9ea3-b5055117eff2 None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:29.537748 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d31135-93f8-4c9b-9ea3-b5055117eff2 None admin] PATH_INFO: `/v3/services` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:29.538524 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d31135-93f8-4c9b-9ea3-b5055117eff2 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=88080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:22:29.538850 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d31135-93f8-4c9b-9ea3-b5055117eff2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:29.540357 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d31135-93f8-4c9b-9ea3-b5055117eff2 None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:29.546426 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 371/736] 10.222.0.18 () {56 vars in 1114 bytes} [Sat Sep 24 19:22:29 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:22:29.553019 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d31135-93f8-4c9b-9ea3-b5055117eff2 None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:29.554179 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:22:29.663146 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edc35fb-c98a-4e99-ac26-b348ff68e4c0 None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:29.675056 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d31135-93f8-4c9b-9ea3-b5055117eff2 None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:29.704452 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa0344c-ccff-49ba-9eeb-057503a13117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:29.705061 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa0344c-ccff-49ba-9eeb-057503a13117 None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:29.705337 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa0344c-ccff-49ba-9eeb-057503a13117 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:29.705729 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa0344c-ccff-49ba-9eeb-057503a13117 None admin] PATH_INFO: `/v3/roles` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:29.706440 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa0344c-ccff-49ba-9eeb-057503a13117 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:22:29.706733 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa0344c-ccff-49ba-9eeb-057503a13117 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:29.708094 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa0344c-ccff-49ba-9eeb-057503a13117 None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:29.715090 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d215cd83-c6d3-479e-ae0e-c23d55604820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:29.715660 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d215cd83-c6d3-479e-ae0e-c23d55604820 None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:29.715962 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d215cd83-c6d3-479e-ae0e-c23d55604820 None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:29.716250 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d215cd83-c6d3-479e-ae0e-c23d55604820 None admin] PATH_INFO: `/v3/services` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:29.716816 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d215cd83-c6d3-479e-ae0e-c23d55604820 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=88080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:22:29.717111 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d215cd83-c6d3-479e-ae0e-c23d55604820 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:29.718283 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 366/737] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Sep 24 19:22:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:22:29.718571 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d215cd83-c6d3-479e-ae0e-c23d55604820 None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:29.725439 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa0344c-ccff-49ba-9eeb-057503a13117 None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:29.726686 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 372/738] 10.222.0.18 () {56 vars in 1114 bytes} [Sat Sep 24 19:22:29 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:22:29.847188 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:22:29.873324 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa0344c-ccff-49ba-9eeb-057503a13117 None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:29.915712 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15edd21c-1ea7-4d0a-b4da-c74c917e2775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:29.916403 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15edd21c-1ea7-4d0a-b4da-c74c917e2775 None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:29.916686 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15edd21c-1ea7-4d0a-b4da-c74c917e2775 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:29.916964 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15edd21c-1ea7-4d0a-b4da-c74c917e2775 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:29.929879 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15edd21c-1ea7-4d0a-b4da-c74c917e2775 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:29.931550 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15edd21c-1ea7-4d0a-b4da-c74c917e2775 None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:29.950019 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application [None req-15edd21c-1ea7-4d0a-b4da-c74c917e2775 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:22:29.950019 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:22:29.950019 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:22:29.950019 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:22:29.950019 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:22:29.950019 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:22:29.950019 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:22:29.950019 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:22:29.950019 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:22:29.950019 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:22:29.950019 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:22:29.950019 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:22:29.950019 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:22:29.950019 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:22:29.950019 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:22:29.950019 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:22:29.951324 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:22:29.951324 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:22:29.951324 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:22:29.951324 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:22:29.951324 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:22:29.951324 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:22:29.951324 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:22:29.951324 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application with Lock( Sep 24 19:22:29.951324 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:22:29.951324 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:22:29.951324 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:22:29.951324 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:22:29.951324 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:22:29.951324 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:22:29.951324 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:22:29.951324 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:22:29.951324 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:22:29.952464 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:22:29.952464 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:22:29.952464 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Sep 24 19:22:29.952464 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 367/739] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Sep 24 19:22:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:22:29.957950 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d215cd83-c6d3-479e-ae0e-c23d55604820 None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:29.987215 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:22:30.077073 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d215cd83-c6d3-479e-ae0e-c23d55604820 None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:30.119433 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c97dd5-b4b6-49cb-b536-b647879f5dc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:30.120133 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c97dd5-b4b6-49cb-b536-b647879f5dc0 None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:30.120424 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c97dd5-b4b6-49cb-b536-b647879f5dc0 None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:30.120732 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c97dd5-b4b6-49cb-b536-b647879f5dc0 None admin] PATH_INFO: `/v3/domains` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:30.122014 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c97dd5-b4b6-49cb-b536-b647879f5dc0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:22:30.122346 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c97dd5-b4b6-49cb-b536-b647879f5dc0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:30.123890 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c97dd5-b4b6-49cb-b536-b647879f5dc0 None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:30.141860 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 373/740] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Sep 24 19:22:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:22:30.143856 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15edd21c-1ea7-4d0a-b4da-c74c917e2775 None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:30.264664 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15edd21c-1ea7-4d0a-b4da-c74c917e2775 None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:30.303375 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ae1293-822d-4d64-a613-09c46d974a38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:30.304051 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ae1293-822d-4d64-a613-09c46d974a38 None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:30.304331 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ae1293-822d-4d64-a613-09c46d974a38 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:30.304623 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ae1293-822d-4d64-a613-09c46d974a38 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:30.306854 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:22:30.317081 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ae1293-822d-4d64-a613-09c46d974a38 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:30.318560 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ae1293-822d-4d64-a613-09c46d974a38 None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:30.332094 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application [None req-01ae1293-822d-4d64-a613-09c46d974a38 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 24 19:22:30.332094 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:22:30.332094 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:22:30.332094 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:22:30.332094 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:22:30.332094 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:22:30.332094 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:22:30.332094 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:22:30.332094 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:22:30.332094 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:22:30.332094 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:22:30.332094 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:22:30.332094 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 24 19:22:30.332094 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 24 19:22:30.332094 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 24 19:22:30.332094 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 24 19:22:30.338131 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:22:30.338131 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:22:30.338131 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 24 19:22:30.338131 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 19:22:30.338131 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 24 19:22:30.338131 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 19:22:30.338131 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:22:30.338131 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:22:30.338131 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:22:30.338131 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:22:30.338131 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:22:30.338131 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application with Lock( Sep 24 19:22:30.338131 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:22:30.338131 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:22:30.338131 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:22:30.338131 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:22:30.338131 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:22:30.338131 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:22:30.339164 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:22:30.339164 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:22:30.339164 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 24 19:22:30.339164 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 24 19:22:30.339164 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 24 19:22:30.339164 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 24 19:22:30.339164 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 24 19:22:30.339164 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 24 19:22:30.339164 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 24 19:22:30.339164 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Sep 24 19:22:30.339164 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 368/741] 10.222.0.18 () {56 vars in 1093 bytes} [Sat Sep 24 19:22:30 2022] GET /identity/v3/users/nova => generated 82 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:22:30.340746 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c97dd5-b4b6-49cb-b536-b647879f5dc0 None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:30.425772 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:22:30.447063 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c97dd5-b4b6-49cb-b536-b647879f5dc0 None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:30.483105 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1278f37-6590-4c3c-be1a-50b007564221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:30.483708 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1278f37-6590-4c3c-be1a-50b007564221 None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:30.483981 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1278f37-6590-4c3c-be1a-50b007564221 None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:30.484249 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1278f37-6590-4c3c-be1a-50b007564221 None admin] PATH_INFO: `/v3/users` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:30.484971 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1278f37-6590-4c3c-be1a-50b007564221 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:22:30.485272 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1278f37-6590-4c3c-be1a-50b007564221 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:30.486706 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1278f37-6590-4c3c-be1a-50b007564221 None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:30.506710 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 374/742] 10.222.0.18 () {56 vars in 1133 bytes} [Sat Sep 24 19:22:30 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:22:30.512161 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ae1293-822d-4d64-a613-09c46d974a38 None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:30.618751 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ae1293-822d-4d64-a613-09c46d974a38 None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:30.653806 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2e1e40-30b1-49c5-abb4-412df965f610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:30.657874 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2e1e40-30b1-49c5-abb4-412df965f610 None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:30.657874 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2e1e40-30b1-49c5-abb4-412df965f610 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:30.657874 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2e1e40-30b1-49c5-abb4-412df965f610 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:30.727235 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:22:30.738070 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2e1e40-30b1-49c5-abb4-412df965f610 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:30.739531 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2e1e40-30b1-49c5-abb4-412df965f610 None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:30.854613 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 369/743] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Sep 24 19:22:30 2022] GET /identity/v3/auth/tokens => generated 1406 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 24 19:22:30.860624 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1278f37-6590-4c3c-be1a-50b007564221 None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:30.968127 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1278f37-6590-4c3c-be1a-50b007564221 None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:31.004712 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482597f2-6ca2-4e45-b749-233797fd35f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:31.005648 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482597f2-6ca2-4e45-b749-233797fd35f3 None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:31.006172 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482597f2-6ca2-4e45-b749-233797fd35f3 None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:31.006648 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482597f2-6ca2-4e45-b749-233797fd35f3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:31.022530 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:22:31.026570 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482597f2-6ca2-4e45-b749-233797fd35f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:31.030516 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482597f2-6ca2-4e45-b749-233797fd35f3 None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:31.064118 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application [None req-482597f2-6ca2-4e45-b749-233797fd35f3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:22:31.064118 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:22:31.064118 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:22:31.064118 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:22:31.064118 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:22:31.064118 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:22:31.064118 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:22:31.064118 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:22:31.064118 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:22:31.064118 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:22:31.064118 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:22:31.064118 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:22:31.064118 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:22:31.064118 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:22:31.064118 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:22:31.064118 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:22:31.065106 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:22:31.065106 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:22:31.065106 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:22:31.065106 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:22:31.065106 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:22:31.065106 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:22:31.065106 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:22:31.065106 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application with Lock( Sep 24 19:22:31.065106 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:22:31.065106 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:22:31.065106 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:22:31.065106 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:22:31.065106 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:22:31.065106 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:22:31.065106 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:22:31.065106 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:22:31.065106 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:22:31.066056 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:22:31.066056 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:22:31.066056 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Sep 24 19:22:31.066707 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 375/744] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Sep 24 19:22:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:22:31.074139 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2e1e40-30b1-49c5-abb4-412df965f610 None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:31.200996 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:22:31.209694 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2e1e40-30b1-49c5-abb4-412df965f610 None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:31.249619 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4e3fbf-e95b-449f-834a-1a6209106849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:31.250186 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4e3fbf-e95b-449f-834a-1a6209106849 None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:31.250464 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4e3fbf-e95b-449f-834a-1a6209106849 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:31.250734 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4e3fbf-e95b-449f-834a-1a6209106849 None admin] PATH_INFO: `/v3/domains` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:31.251397 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4e3fbf-e95b-449f-834a-1a6209106849 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:22:31.251690 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4e3fbf-e95b-449f-834a-1a6209106849 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:31.253066 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4e3fbf-e95b-449f-834a-1a6209106849 None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:31.270949 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 370/745] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Sep 24 19:22:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:22:31.272540 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482597f2-6ca2-4e45-b749-233797fd35f3 None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:31.385596 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482597f2-6ca2-4e45-b749-233797fd35f3 None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:31.421327 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2f19b1-be2c-4e08-b601-3284574eef30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:31.422000 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2f19b1-be2c-4e08-b601-3284574eef30 None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:31.422278 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2f19b1-be2c-4e08-b601-3284574eef30 None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:31.422547 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2f19b1-be2c-4e08-b601-3284574eef30 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:31.432520 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2f19b1-be2c-4e08-b601-3284574eef30 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:31.434055 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2f19b1-be2c-4e08-b601-3284574eef30 None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:31.445871 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application [None req-6e2f19b1-be2c-4e08-b601-3284574eef30 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 19:22:31.445871 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:22:31.445871 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:22:31.445871 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:22:31.445871 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:22:31.445871 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:22:31.445871 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:22:31.445871 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:22:31.445871 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:22:31.445871 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:22:31.445871 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:22:31.445871 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:22:31.445871 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 24 19:22:31.445871 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 24 19:22:31.445871 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 24 19:22:31.446796 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 24 19:22:31.446796 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:22:31.446796 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:22:31.446796 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:22:31.446796 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:22:31.446796 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:22:31.446796 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:22:31.446796 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:22:31.446796 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application with Lock( Sep 24 19:22:31.446796 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:22:31.446796 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:22:31.446796 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:22:31.446796 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:22:31.446796 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:22:31.446796 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:22:31.446796 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:22:31.446796 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:22:31.447680 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 24 19:22:31.447680 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 24 19:22:31.447680 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 24 19:22:31.447680 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 24 19:22:31.447680 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 24 19:22:31.447680 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 24 19:22:31.447680 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 19:22:31.447680 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Sep 24 19:22:31.448753 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 376/746] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Sep 24 19:22:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:22:31.453331 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4e3fbf-e95b-449f-834a-1a6209106849 None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:31.475705 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f65ede-04c6-415e-abd9-f5a23b819051 None None] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:31.476005 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f65ede-04c6-415e-abd9-f5a23b819051 None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:31.476243 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f65ede-04c6-415e-abd9-f5a23b819051 None None] PATH_INFO: `/` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:31.477691 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 377/747] 10.222.0.18 () {54 vars in 927 bytes} [Sat Sep 24 19:22:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 24 19:22:31.483015 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628c191b-f990-4100-bb5d-1ab86b02baaf None None] REQUEST_METHOD: `POST` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:31.483293 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628c191b-f990-4100-bb5d-1ab86b02baaf None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:31.483562 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628c191b-f990-4100-bb5d-1ab86b02baaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:31.505303 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.auth.core [None req-628c191b-f990-4100-bb5d-1ab86b02baaf None None] MFA Rules not processed for user `3dbbb9909cec43ff99c1c3682f016ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=88080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:22:31.506443 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.fernet_utils [None req-628c191b-f990-4100-bb5d-1ab86b02baaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:22:31.560892 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:22:31.565814 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4e3fbf-e95b-449f-834a-1a6209106849 None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:31.586266 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 378/748] 10.222.0.18 () {58 vars in 1024 bytes} [Sat Sep 24 19:22:31 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 24 19:22:31.602037 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1070a670-0c0d-4b62-8e64-7bbea3cd33ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:31.602641 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1070a670-0c0d-4b62-8e64-7bbea3cd33ea None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:31.602914 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1070a670-0c0d-4b62-8e64-7bbea3cd33ea None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:31.603179 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1070a670-0c0d-4b62-8e64-7bbea3cd33ea None admin] PATH_INFO: `/v3/projects` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:31.603856 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1070a670-0c0d-4b62-8e64-7bbea3cd33ea None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:22:31.604157 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1070a670-0c0d-4b62-8e64-7bbea3cd33ea None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:31.605591 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1070a670-0c0d-4b62-8e64-7bbea3cd33ea None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:31.623669 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 371/749] 10.222.0.18 () {56 vars in 1148 bytes} [Sat Sep 24 19:22:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:22:31.624741 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628c191b-f990-4100-bb5d-1ab86b02baaf None None] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:31.733910 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628c191b-f990-4100-bb5d-1ab86b02baaf None None] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:31.775334 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56665c8-9bbd-4d05-bf8f-2f58ccbd4390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:31.775939 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56665c8-9bbd-4d05-bf8f-2f58ccbd4390 None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:31.776215 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56665c8-9bbd-4d05-bf8f-2f58ccbd4390 None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:31.776480 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56665c8-9bbd-4d05-bf8f-2f58ccbd4390 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:31.777204 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56665c8-9bbd-4d05-bf8f-2f58ccbd4390 None admin] RBAC: Adding query filter params (role.id=4c7d0dafc19b4b0a9821be6ec0da0a8f, scope.project.id=9dfa5c2c17244006bdd629ec81553f1a, user.id=0ab73abe1c6e4b25a17281f4cd8e97e9) {{(pid=88080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:22:31.778038 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56665c8-9bbd-4d05-bf8f-2f58ccbd4390 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:31.779510 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56665c8-9bbd-4d05-bf8f-2f58ccbd4390 None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:31.785754 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 379/750] 10.222.0.18 () {56 vars in 1374 bytes} [Sat Sep 24 19:22:31 2022] GET /identity/v3/role_assignments?user.id=0ab73abe1c6e4b25a17281f4cd8e97e9&scope.project.id=9dfa5c2c17244006bdd629ec81553f1a&role.id=4c7d0dafc19b4b0a9821be6ec0da0a8f => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:22:31.912868 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1070a670-0c0d-4b62-8e64-7bbea3cd33ea None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:31.930049 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:22:32.025088 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1070a670-0c0d-4b62-8e64-7bbea3cd33ea None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:32.063588 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a52b87a-d976-4258-9418-bf5113649b4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:32.064685 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a52b87a-d976-4258-9418-bf5113649b4d None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:32.064999 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a52b87a-d976-4258-9418-bf5113649b4d None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:32.065296 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a52b87a-d976-4258-9418-bf5113649b4d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:32.138760 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a52b87a-d976-4258-9418-bf5113649b4d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:32.140187 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a52b87a-d976-4258-9418-bf5113649b4d None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:32.155524 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:22:32.241925 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 372/751] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Sep 24 19:22:31 2022] GET /identity/v3/auth/tokens => generated 1406 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 24 19:22:32.247465 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56665c8-9bbd-4d05-bf8f-2f58ccbd4390 None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:32.294319 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:22:32.314668 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67714327-b5a4-4138-9f93-b266589960a9 None None] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:32.314990 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67714327-b5a4-4138-9f93-b266589960a9 None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:32.315219 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67714327-b5a4-4138-9f93-b266589960a9 None None] PATH_INFO: `/` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:32.316688 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 373/752] 10.222.0.18 () {54 vars in 927 bytes} [Sat Sep 24 19:22:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 24 19:22:32.321814 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9155ad6-bd19-48f4-8358-91ef08c5421e None None] REQUEST_METHOD: `POST` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:32.322122 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9155ad6-bd19-48f4-8358-91ef08c5421e None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:32.322389 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9155ad6-bd19-48f4-8358-91ef08c5421e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:32.342201 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.auth.core [None req-b9155ad6-bd19-48f4-8358-91ef08c5421e None None] MFA Rules not processed for user `3dbbb9909cec43ff99c1c3682f016ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=88081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:22:32.343413 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.fernet_utils [None req-b9155ad6-bd19-48f4-8358-91ef08c5421e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:22:32.352567 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56665c8-9bbd-4d05-bf8f-2f58ccbd4390 None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:32.389082 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03e6184-feb8-4cfa-ad87-fc397cafe505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:32.389751 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03e6184-feb8-4cfa-ad87-fc397cafe505 None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:32.389996 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03e6184-feb8-4cfa-ad87-fc397cafe505 None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:32.390260 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03e6184-feb8-4cfa-ad87-fc397cafe505 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:32.401101 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03e6184-feb8-4cfa-ad87-fc397cafe505 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:32.402609 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03e6184-feb8-4cfa-ad87-fc397cafe505 None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:32.416792 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application [None req-f03e6184-feb8-4cfa-ad87-fc397cafe505 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:22:32.416792 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:22:32.416792 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:22:32.416792 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:22:32.416792 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:22:32.416792 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:22:32.416792 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:22:32.416792 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:22:32.416792 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:22:32.416792 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:22:32.416792 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:22:32.416792 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:22:32.416792 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:22:32.416792 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:22:32.416792 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:22:32.416792 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:22:32.418172 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:22:32.418172 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:22:32.418172 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:22:32.418172 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:22:32.418172 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:22:32.418172 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:22:32.418172 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:22:32.418172 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application with Lock( Sep 24 19:22:32.418172 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:22:32.418172 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:22:32.418172 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:22:32.418172 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:22:32.418172 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:22:32.418172 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:22:32.418172 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:22:32.418172 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:22:32.418172 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:22:32.419110 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:22:32.419110 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:22:32.419110 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Sep 24 19:22:32.422755 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 374/753] 10.222.0.18 () {58 vars in 1024 bytes} [Sat Sep 24 19:22:32 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 24 19:22:32.422885 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 380/754] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Sep 24 19:22:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:22:32.423667 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9155ad6-bd19-48f4-8358-91ef08c5421e None None] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:32.477175 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:22:32.539227 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9155ad6-bd19-48f4-8358-91ef08c5421e None None] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:32.580623 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92911996-6b93-469f-93f3-ff69871232e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:32.581201 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92911996-6b93-469f-93f3-ff69871232e1 None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:32.581437 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92911996-6b93-469f-93f3-ff69871232e1 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:32.581709 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92911996-6b93-469f-93f3-ff69871232e1 None admin] PATH_INFO: `/v3/domains` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:32.582383 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92911996-6b93-469f-93f3-ff69871232e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:22:32.582682 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92911996-6b93-469f-93f3-ff69871232e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:32.584048 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92911996-6b93-469f-93f3-ff69871232e1 None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:32.596337 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 375/755] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Sep 24 19:22:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:22:32.757187 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03e6184-feb8-4cfa-ad87-fc397cafe505 None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:32.862958 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:22:32.867228 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03e6184-feb8-4cfa-ad87-fc397cafe505 None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:32.904450 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d97399-c297-4031-be54-1a3992b96e5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:32.905050 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d97399-c297-4031-be54-1a3992b96e5e None admin] REQUEST_METHOD: `POST` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:32.905328 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d97399-c297-4031-be54-1a3992b96e5e None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:32.905603 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d97399-c297-4031-be54-1a3992b96e5e None admin] PATH_INFO: `/v3/services` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:32.906307 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d97399-c297-4031-be54-1a3992b96e5e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:32.907728 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d97399-c297-4031-be54-1a3992b96e5e None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:32.925419 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 381/756] 10.222.0.18 () {60 vars in 1141 bytes} [Sat Sep 24 19:22:32 2022] POST /identity/v3/services => generated 251 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:22:34.254824 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0b0672-2391-480e-b4c2-c4bd620a408a None None] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:34.255383 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0b0672-2391-480e-b4c2-c4bd620a408a None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:34.255383 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0b0672-2391-480e-b4c2-c4bd620a408a None None] PATH_INFO: `/` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:34.256726 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 376/757] 10.222.0.18 () {54 vars in 927 bytes} [Sat Sep 24 19:22:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:22:34.263471 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47cdbe8-66d0-4885-b6b8-f1c25a36feba None None] REQUEST_METHOD: `POST` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:34.264011 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47cdbe8-66d0-4885-b6b8-f1c25a36feba None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:34.264126 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47cdbe8-66d0-4885-b6b8-f1c25a36feba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:34.284033 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.auth.core [None req-b47cdbe8-66d0-4885-b6b8-f1c25a36feba None None] MFA Rules not processed for user `3dbbb9909cec43ff99c1c3682f016ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=88080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:22:34.285249 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.fernet_utils [None req-b47cdbe8-66d0-4885-b6b8-f1c25a36feba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:22:34.363670 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 382/758] 10.222.0.18 () {58 vars in 1024 bytes} [Sat Sep 24 19:22:34 2022] POST /identity/v3/auth/tokens => generated 1507 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 24 19:22:34.679648 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0b0672-2391-480e-b4c2-c4bd620a408a None None] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:34.782081 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0b0672-2391-480e-b4c2-c4bd620a408a None None] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:34.784478 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:22:34.815971 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e375f8fe-3448-4b08-aa33-105b7e86efa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:34.816593 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e375f8fe-3448-4b08-aa33-105b7e86efa3 None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:34.816868 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e375f8fe-3448-4b08-aa33-105b7e86efa3 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:34.817135 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e375f8fe-3448-4b08-aa33-105b7e86efa3 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:34.817701 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e375f8fe-3448-4b08-aa33-105b7e86efa3 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:34.819098 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e375f8fe-3448-4b08-aa33-105b7e86efa3 None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:34.828309 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application [None req-e375f8fe-3448-4b08-aa33-105b7e86efa3 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 24 19:22:34.828309 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:22:34.828309 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 24 19:22:34.828309 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 24 19:22:34.828309 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 24 19:22:34.828309 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 24 19:22:34.828309 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 24 19:22:34.828309 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 19:22:34.828309 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 24 19:22:34.828309 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Sep 24 19:22:34.828309 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 24 19:22:34.828309 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Sep 24 19:22:34.828309 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:22:34.828309 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:22:34.828309 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:22:34.828309 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:22:34.829437 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:22:34.829437 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:22:34.829437 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:22:34.829437 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:22:34.829437 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:22:34.829437 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:22:34.829437 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:22:34.829437 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 24 19:22:34.829437 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 24 19:22:34.829437 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 24 19:22:34.829437 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 24 19:22:34.829437 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:22:34.829437 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:22:34.829437 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:22:34.829437 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:22:34.829437 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:22:34.829437 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:22:34.830585 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:22:34.830585 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application with Lock( Sep 24 19:22:34.830585 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:22:34.830585 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:22:34.830585 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:22:34.830585 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:22:34.830585 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:22:34.830585 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:22:34.830585 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:22:34.830585 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:22:34.830585 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 24 19:22:34.830585 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 19:22:34.830585 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 24 19:22:34.830585 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Sep 24 19:22:34.833973 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 377/759] 10.222.0.18 () {56 vars in 1132 bytes} [Sat Sep 24 19:22:34 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:22:34.835281 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47cdbe8-66d0-4885-b6b8-f1c25a36feba None None] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:34.917938 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:22:34.935329 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47cdbe8-66d0-4885-b6b8-f1c25a36feba None None] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:34.969408 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993408bb-9de8-40b1-9a4d-75f6b289cc73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:34.970047 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993408bb-9de8-40b1-9a4d-75f6b289cc73 None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:34.970330 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993408bb-9de8-40b1-9a4d-75f6b289cc73 None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:34.970601 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993408bb-9de8-40b1-9a4d-75f6b289cc73 None admin] PATH_INFO: `/v3/services` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:34.971227 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993408bb-9de8-40b1-9a4d-75f6b289cc73 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=88080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:22:34.971527 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993408bb-9de8-40b1-9a4d-75f6b289cc73 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:34.972883 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993408bb-9de8-40b1-9a4d-75f6b289cc73 None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:34.977372 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 383/760] 10.222.0.18 () {56 vars in 1126 bytes} [Sat Sep 24 19:22:34 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:22:34.983724 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e375f8fe-3448-4b08-aa33-105b7e86efa3 None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:35.086599 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e375f8fe-3448-4b08-aa33-105b7e86efa3 None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:35.126841 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8a4d68-300e-45ea-be9d-d0617db9848d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:35.127497 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8a4d68-300e-45ea-be9d-d0617db9848d None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:35.127773 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8a4d68-300e-45ea-be9d-d0617db9848d None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:35.128039 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8a4d68-300e-45ea-be9d-d0617db9848d None admin] PATH_INFO: `/v3/services` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:35.128657 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8a4d68-300e-45ea-be9d-d0617db9848d None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=88081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:22:35.128953 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8a4d68-300e-45ea-be9d-d0617db9848d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:35.130330 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8a4d68-300e-45ea-be9d-d0617db9848d None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:35.134677 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 378/761] 10.222.0.18 () {56 vars in 1126 bytes} [Sat Sep 24 19:22:34 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:22:35.439635 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92afbd3c-0826-403b-bc19-38b752da7977 None None] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:35.440198 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92afbd3c-0826-403b-bc19-38b752da7977 None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:35.440198 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92afbd3c-0826-403b-bc19-38b752da7977 None None] PATH_INFO: `/` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:35.441641 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 384/762] 10.222.0.18 () {54 vars in 927 bytes} [Sat Sep 24 19:22:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:22:35.446947 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ebc7de-51ca-4167-9f9d-643ffa273da1 None None] REQUEST_METHOD: `POST` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:35.447385 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ebc7de-51ca-4167-9f9d-643ffa273da1 None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:35.447497 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ebc7de-51ca-4167-9f9d-643ffa273da1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:35.466541 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.auth.core [None req-a7ebc7de-51ca-4167-9f9d-643ffa273da1 None None] MFA Rules not processed for user `3dbbb9909cec43ff99c1c3682f016ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=88081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:22:35.467716 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.fernet_utils [None req-a7ebc7de-51ca-4167-9f9d-643ffa273da1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:22:35.493562 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:22:35.535289 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 379/763] 10.222.0.18 () {58 vars in 1024 bytes} [Sat Sep 24 19:22:35 2022] POST /identity/v3/auth/tokens => generated 1507 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 19:22:35.859857 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92afbd3c-0826-403b-bc19-38b752da7977 None None] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:35.965702 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92afbd3c-0826-403b-bc19-38b752da7977 None None] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:35.998861 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ea545e-8192-46a7-a6ca-52be5aecce97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:35.999478 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ea545e-8192-46a7-a6ca-52be5aecce97 None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:35.999752 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ea545e-8192-46a7-a6ca-52be5aecce97 None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:36.000019 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ea545e-8192-46a7-a6ca-52be5aecce97 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:36.000588 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ea545e-8192-46a7-a6ca-52be5aecce97 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:36.001972 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ea545e-8192-46a7-a6ca-52be5aecce97 None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:36.012497 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application [None req-d8ea545e-8192-46a7-a6ca-52be5aecce97 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 24 19:22:36.012497 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:22:36.012497 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 24 19:22:36.012497 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 24 19:22:36.012497 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 24 19:22:36.012497 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 24 19:22:36.012497 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 24 19:22:36.012497 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 19:22:36.012497 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 24 19:22:36.012497 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Sep 24 19:22:36.012497 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 24 19:22:36.012497 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Sep 24 19:22:36.012497 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:22:36.012497 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:22:36.012497 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:22:36.012497 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:22:36.012497 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:22:36.013582 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:22:36.013582 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:22:36.013582 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:22:36.013582 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:22:36.013582 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:22:36.013582 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:22:36.013582 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 24 19:22:36.013582 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 24 19:22:36.013582 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 24 19:22:36.013582 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 24 19:22:36.013582 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:22:36.013582 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:22:36.013582 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:22:36.013582 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:22:36.013582 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:22:36.013582 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:22:36.014508 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:22:36.014508 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application with Lock( Sep 24 19:22:36.014508 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:22:36.014508 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:22:36.014508 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:22:36.014508 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:22:36.014508 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:22:36.014508 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:22:36.014508 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:22:36.014508 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:22:36.014508 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 24 19:22:36.014508 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 19:22:36.014508 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 24 19:22:36.014508 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Sep 24 19:22:36.014508 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 385/764] 10.222.0.18 () {56 vars in 1114 bytes} [Sat Sep 24 19:22:35 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:22:36.019665 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ebc7de-51ca-4167-9f9d-643ffa273da1 None None] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:36.117102 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ebc7de-51ca-4167-9f9d-643ffa273da1 None None] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:36.151056 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058bac73-6618-4552-aa58-b3a8f56762a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:36.151658 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058bac73-6618-4552-aa58-b3a8f56762a4 None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:36.151936 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058bac73-6618-4552-aa58-b3a8f56762a4 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:36.152586 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058bac73-6618-4552-aa58-b3a8f56762a4 None admin] PATH_INFO: `/v3/services` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:36.153244 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058bac73-6618-4552-aa58-b3a8f56762a4 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=88081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:22:36.153545 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058bac73-6618-4552-aa58-b3a8f56762a4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:36.154923 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058bac73-6618-4552-aa58-b3a8f56762a4 None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:36.159520 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 380/765] 10.222.0.18 () {56 vars in 1114 bytes} [Sat Sep 24 19:22:36 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:22:36.165356 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ea545e-8192-46a7-a6ca-52be5aecce97 None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:36.180597 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:22:36.268893 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ea545e-8192-46a7-a6ca-52be5aecce97 None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:36.305174 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a6c6f9-7716-4f89-858b-6f059bb83034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:36.305789 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a6c6f9-7716-4f89-858b-6f059bb83034 None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:36.306101 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a6c6f9-7716-4f89-858b-6f059bb83034 None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:36.306380 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a6c6f9-7716-4f89-858b-6f059bb83034 None admin] PATH_INFO: `/v3/services` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:36.307010 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a6c6f9-7716-4f89-858b-6f059bb83034 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=88080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:22:36.307310 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a6c6f9-7716-4f89-858b-6f059bb83034 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:36.309201 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a6c6f9-7716-4f89-858b-6f059bb83034 None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:36.314653 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 386/766] 10.222.0.18 () {56 vars in 1114 bytes} [Sat Sep 24 19:22:36 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:22:36.320787 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058bac73-6618-4552-aa58-b3a8f56762a4 None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:36.347943 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:22:36.423258 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058bac73-6618-4552-aa58-b3a8f56762a4 None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:36.458109 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09036ae-d6fc-4449-a93d-0f6d1f1ff111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:36.458885 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09036ae-d6fc-4449-a93d-0f6d1f1ff111 None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:36.459050 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09036ae-d6fc-4449-a93d-0f6d1f1ff111 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:36.459200 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09036ae-d6fc-4449-a93d-0f6d1f1ff111 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:36.459891 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09036ae-d6fc-4449-a93d-0f6d1f1ff111 None admin] RBAC: Adding query filter params (interface=public, service_id=ee14ba4027b347dd9605eab01d94b33b, region_id=RegionOne) {{(pid=88081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:22:36.460192 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09036ae-d6fc-4449-a93d-0f6d1f1ff111 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:36.461547 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09036ae-d6fc-4449-a93d-0f6d1f1ff111 None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:36.467247 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 381/767] 10.222.0.18 () {56 vars in 1251 bytes} [Sat Sep 24 19:22:36 2022] GET /identity/v3/endpoints?service_id=ee14ba4027b347dd9605eab01d94b33b&interface=public®ion_id=RegionOne => generated 194 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:22:36.472945 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a6c6f9-7716-4f89-858b-6f059bb83034 None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:36.562779 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:22:36.586893 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a6c6f9-7716-4f89-858b-6f059bb83034 None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:36.620070 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a50217-8094-44d9-bad4-c77794029db9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:36.620660 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a50217-8094-44d9-bad4-c77794029db9 None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:36.621519 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a50217-8094-44d9-bad4-c77794029db9 None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:36.621784 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a50217-8094-44d9-bad4-c77794029db9 None admin] PATH_INFO: `/v3/services` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:36.622403 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a50217-8094-44d9-bad4-c77794029db9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:36.623745 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a50217-8094-44d9-bad4-c77794029db9 None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:36.629108 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 387/768] 10.222.0.18 () {56 vars in 1087 bytes} [Sat Sep 24 19:22:36 2022] GET /identity/v3/services => generated 1241 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 24 19:22:37.613331 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae9e657-aeb7-459a-a348-5d58623fae5f None None] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:37.613910 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae9e657-aeb7-459a-a348-5d58623fae5f None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:37.613910 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae9e657-aeb7-459a-a348-5d58623fae5f None None] PATH_INFO: `/` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:37.615218 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 382/769] 10.222.0.18 () {54 vars in 927 bytes} [Sat Sep 24 19:22:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:22:37.620392 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c0edf7-96f2-4c1a-baa5-dc6ddaa6ceae None None] REQUEST_METHOD: `POST` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:37.621365 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c0edf7-96f2-4c1a-baa5-dc6ddaa6ceae None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:37.621469 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c0edf7-96f2-4c1a-baa5-dc6ddaa6ceae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:37.639777 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.auth.core [None req-74c0edf7-96f2-4c1a-baa5-dc6ddaa6ceae None None] MFA Rules not processed for user `3dbbb9909cec43ff99c1c3682f016ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=88080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:22:37.640947 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.fernet_utils [None req-74c0edf7-96f2-4c1a-baa5-dc6ddaa6ceae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:22:37.710158 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 388/770] 10.222.0.18 () {58 vars in 1024 bytes} [Sat Sep 24 19:22:37 2022] POST /identity/v3/auth/tokens => generated 1507 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 19:22:38.034367 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae9e657-aeb7-459a-a348-5d58623fae5f None None] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:38.125081 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:22:38.136177 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae9e657-aeb7-459a-a348-5d58623fae5f None None] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:38.170453 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b3a511-6b37-4b53-aebb-a9a3f8090784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:38.171053 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b3a511-6b37-4b53-aebb-a9a3f8090784 None admin] REQUEST_METHOD: `POST` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:38.171334 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b3a511-6b37-4b53-aebb-a9a3f8090784 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:38.171604 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b3a511-6b37-4b53-aebb-a9a3f8090784 None admin] PATH_INFO: `/v3/services` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:38.172259 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b3a511-6b37-4b53-aebb-a9a3f8090784 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:38.173641 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b3a511-6b37-4b53-aebb-a9a3f8090784 None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:38.189559 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 383/771] 10.222.0.18 () {60 vars in 1141 bytes} [Sat Sep 24 19:22:38 2022] POST /identity/v3/services => generated 269 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:22:39.050048 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ce9cb1-a3c2-42d5-bb96-e94ba9aa3942 None None] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:39.050556 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ce9cb1-a3c2-42d5-bb96-e94ba9aa3942 None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:39.050556 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ce9cb1-a3c2-42d5-bb96-e94ba9aa3942 None None] PATH_INFO: `/` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:39.051999 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 389/772] 10.222.0.18 () {54 vars in 927 bytes} [Sat Sep 24 19:22:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:22:39.057517 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e00a3f-b89a-4cd8-b63c-56297fc2cb77 None None] REQUEST_METHOD: `POST` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:39.058021 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e00a3f-b89a-4cd8-b63c-56297fc2cb77 None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:39.058021 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e00a3f-b89a-4cd8-b63c-56297fc2cb77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:39.076451 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.auth.core [None req-f7e00a3f-b89a-4cd8-b63c-56297fc2cb77 None None] MFA Rules not processed for user `3dbbb9909cec43ff99c1c3682f016ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=88081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:22:39.077623 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.fernet_utils [None req-f7e00a3f-b89a-4cd8-b63c-56297fc2cb77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:22:39.147884 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 384/773] 10.222.0.18 () {58 vars in 1024 bytes} [Sat Sep 24 19:22:39 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 19:22:39.472883 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ce9cb1-a3c2-42d5-bb96-e94ba9aa3942 None None] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:39.544299 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:22:39.580127 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ce9cb1-a3c2-42d5-bb96-e94ba9aa3942 None None] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:39.628097 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb10484-3dea-4bfc-82f6-4de5a4580136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:39.628734 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb10484-3dea-4bfc-82f6-4de5a4580136 None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:39.629024 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb10484-3dea-4bfc-82f6-4de5a4580136 None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:39.629280 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb10484-3dea-4bfc-82f6-4de5a4580136 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:39.629892 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb10484-3dea-4bfc-82f6-4de5a4580136 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:39.631273 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb10484-3dea-4bfc-82f6-4de5a4580136 None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:39.641636 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application [None req-9fb10484-3dea-4bfc-82f6-4de5a4580136 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 24 19:22:39.641636 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:22:39.641636 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 24 19:22:39.641636 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 24 19:22:39.641636 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 24 19:22:39.641636 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 24 19:22:39.641636 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 24 19:22:39.641636 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 19:22:39.641636 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 24 19:22:39.641636 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Sep 24 19:22:39.641636 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 24 19:22:39.641636 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Sep 24 19:22:39.641636 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:22:39.641636 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:22:39.641636 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:22:39.641636 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:22:39.641636 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:22:39.643061 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:22:39.643061 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:22:39.643061 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:22:39.643061 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:22:39.643061 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:22:39.643061 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:22:39.643061 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 24 19:22:39.643061 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 24 19:22:39.643061 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 24 19:22:39.643061 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 24 19:22:39.643061 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:22:39.643061 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:22:39.643061 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:22:39.643061 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:22:39.643061 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:22:39.643061 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:22:39.644048 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:22:39.644048 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application with Lock( Sep 24 19:22:39.644048 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:22:39.644048 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:22:39.644048 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:22:39.644048 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:22:39.644048 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:22:39.644048 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:22:39.644048 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:22:39.644048 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:22:39.644048 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 24 19:22:39.644048 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 19:22:39.644048 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 24 19:22:39.644048 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Sep 24 19:22:39.644048 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 390/774] 10.222.0.18 () {56 vars in 1114 bytes} [Sat Sep 24 19:22:39 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:22:39.648749 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e00a3f-b89a-4cd8-b63c-56297fc2cb77 None None] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:39.733754 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:22:39.757935 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e00a3f-b89a-4cd8-b63c-56297fc2cb77 None None] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:39.794008 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bddb396-c108-4f61-aa40-da1771e0ecfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:39.794604 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bddb396-c108-4f61-aa40-da1771e0ecfc None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:39.794877 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bddb396-c108-4f61-aa40-da1771e0ecfc None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:39.795140 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bddb396-c108-4f61-aa40-da1771e0ecfc None admin] PATH_INFO: `/v3/services` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:39.795748 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bddb396-c108-4f61-aa40-da1771e0ecfc None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=88081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:22:39.796072 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bddb396-c108-4f61-aa40-da1771e0ecfc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:39.797373 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bddb396-c108-4f61-aa40-da1771e0ecfc None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:39.802216 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 385/775] 10.222.0.18 () {56 vars in 1114 bytes} [Sat Sep 24 19:22:39 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:22:39.808124 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb10484-3dea-4bfc-82f6-4de5a4580136 None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:39.911153 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb10484-3dea-4bfc-82f6-4de5a4580136 None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:39.945692 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e7cf99-f568-467a-b624-06083b2ff3ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:39.946328 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e7cf99-f568-467a-b624-06083b2ff3ff None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:39.946604 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e7cf99-f568-467a-b624-06083b2ff3ff None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:39.946875 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e7cf99-f568-467a-b624-06083b2ff3ff None admin] PATH_INFO: `/v3/services` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:39.947503 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e7cf99-f568-467a-b624-06083b2ff3ff None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=88080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:22:39.947803 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e7cf99-f568-467a-b624-06083b2ff3ff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:39.949726 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e7cf99-f568-467a-b624-06083b2ff3ff None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:39.951049 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:22:39.958024 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 391/776] 10.222.0.18 () {56 vars in 1114 bytes} [Sat Sep 24 19:22:39 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:22:39.961033 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bddb396-c108-4f61-aa40-da1771e0ecfc None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:40.062837 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bddb396-c108-4f61-aa40-da1771e0ecfc None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:40.096645 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c65a462-47ff-400c-a43a-f7648c25df14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:40.097243 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c65a462-47ff-400c-a43a-f7648c25df14 None admin] REQUEST_METHOD: `POST` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:40.097518 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c65a462-47ff-400c-a43a-f7648c25df14 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:40.097785 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c65a462-47ff-400c-a43a-f7648c25df14 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:40.098473 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c65a462-47ff-400c-a43a-f7648c25df14 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:40.099817 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c65a462-47ff-400c-a43a-f7648c25df14 None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:40.109192 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:22:40.121525 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 386/777] 10.222.0.18 () {60 vars in 1144 bytes} [Sat Sep 24 19:22:39 2022] POST /identity/v3/endpoints => generated 346 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:22:40.621459 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527c2638-e5d7-4546-90ed-8826f2d125f1 None None] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:40.622050 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527c2638-e5d7-4546-90ed-8826f2d125f1 None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:40.622050 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527c2638-e5d7-4546-90ed-8826f2d125f1 None None] PATH_INFO: `/` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:40.623357 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 392/778] 10.222.0.18 () {54 vars in 927 bytes} [Sat Sep 24 19:22:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:22:40.628759 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21118143-d3a4-4ba8-aec8-27d88df711de None None] REQUEST_METHOD: `POST` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:40.629047 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21118143-d3a4-4ba8-aec8-27d88df711de None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:40.629323 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21118143-d3a4-4ba8-aec8-27d88df711de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:40.647548 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.auth.core [None req-21118143-d3a4-4ba8-aec8-27d88df711de None None] MFA Rules not processed for user `3dbbb9909cec43ff99c1c3682f016ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=88081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:22:40.648739 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.fernet_utils [None req-21118143-d3a4-4ba8-aec8-27d88df711de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:22:40.725360 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 387/779] 10.222.0.18 () {58 vars in 1024 bytes} [Sat Sep 24 19:22:40 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 19:22:41.057121 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527c2638-e5d7-4546-90ed-8826f2d125f1 None None] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:41.183270 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527c2638-e5d7-4546-90ed-8826f2d125f1 None None] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:41.218163 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65cb1f8-fe1d-4c1e-88fc-82d2de4c1da5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:41.218785 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65cb1f8-fe1d-4c1e-88fc-82d2de4c1da5 None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:41.219060 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65cb1f8-fe1d-4c1e-88fc-82d2de4c1da5 None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:41.219326 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65cb1f8-fe1d-4c1e-88fc-82d2de4c1da5 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:41.219900 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65cb1f8-fe1d-4c1e-88fc-82d2de4c1da5 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:41.221253 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65cb1f8-fe1d-4c1e-88fc-82d2de4c1da5 None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:41.230194 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application [None req-a65cb1f8-fe1d-4c1e-88fc-82d2de4c1da5 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 24 19:22:41.230194 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:22:41.230194 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 24 19:22:41.230194 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 24 19:22:41.230194 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 24 19:22:41.230194 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 24 19:22:41.230194 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 24 19:22:41.230194 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 19:22:41.230194 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 24 19:22:41.230194 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Sep 24 19:22:41.230194 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 24 19:22:41.230194 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Sep 24 19:22:41.230194 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:22:41.230194 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:22:41.230194 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:22:41.230194 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:22:41.231249 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:22:41.231249 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:22:41.231249 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:22:41.231249 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:22:41.231249 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:22:41.231249 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:22:41.231249 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:22:41.231249 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 24 19:22:41.231249 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 24 19:22:41.231249 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 24 19:22:41.231249 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 24 19:22:41.231249 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:22:41.231249 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:22:41.231249 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:22:41.231249 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:22:41.231249 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:22:41.231249 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:22:41.232160 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:22:41.232160 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application with Lock( Sep 24 19:22:41.232160 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:22:41.232160 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:22:41.232160 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:22:41.232160 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:22:41.232160 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:22:41.232160 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:22:41.232160 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:22:41.232160 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:22:41.232160 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 24 19:22:41.232160 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 19:22:41.232160 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 24 19:22:41.232160 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Sep 24 19:22:41.232160 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 393/780] 10.222.0.18 () {56 vars in 1132 bytes} [Sat Sep 24 19:22:41 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:22:41.238417 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21118143-d3a4-4ba8-aec8-27d88df711de None None] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:41.340750 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21118143-d3a4-4ba8-aec8-27d88df711de None None] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:41.363485 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:22:41.376330 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bc3e5d-eac2-44e8-881f-4f9349c2a635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:41.376939 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bc3e5d-eac2-44e8-881f-4f9349c2a635 None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:41.377219 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bc3e5d-eac2-44e8-881f-4f9349c2a635 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:41.377490 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bc3e5d-eac2-44e8-881f-4f9349c2a635 None admin] PATH_INFO: `/v3/services` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:41.378157 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bc3e5d-eac2-44e8-881f-4f9349c2a635 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=88081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:22:41.378462 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bc3e5d-eac2-44e8-881f-4f9349c2a635 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:41.379816 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bc3e5d-eac2-44e8-881f-4f9349c2a635 None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:41.384566 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 388/781] 10.222.0.18 () {56 vars in 1126 bytes} [Sat Sep 24 19:22:41 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:22:41.390821 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65cb1f8-fe1d-4c1e-88fc-82d2de4c1da5 None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:41.453131 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:22:41.494135 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65cb1f8-fe1d-4c1e-88fc-82d2de4c1da5 None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:41.534664 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4047d590-1f78-42fa-9a14-c9cb7fbbfa9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:41.535556 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4047d590-1f78-42fa-9a14-c9cb7fbbfa9f None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:41.535997 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4047d590-1f78-42fa-9a14-c9cb7fbbfa9f None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:41.536417 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4047d590-1f78-42fa-9a14-c9cb7fbbfa9f None admin] PATH_INFO: `/v3/services` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:41.537197 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4047d590-1f78-42fa-9a14-c9cb7fbbfa9f None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=88080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:22:41.537646 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4047d590-1f78-42fa-9a14-c9cb7fbbfa9f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:41.539189 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4047d590-1f78-42fa-9a14-c9cb7fbbfa9f None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:41.544586 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 394/782] 10.222.0.18 () {56 vars in 1126 bytes} [Sat Sep 24 19:22:41 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:22:41.550120 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bc3e5d-eac2-44e8-881f-4f9349c2a635 None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:41.654051 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bc3e5d-eac2-44e8-881f-4f9349c2a635 None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:41.692427 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506ecb86-13a9-4468-bd4f-7f100e74cca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:41.693320 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506ecb86-13a9-4468-bd4f-7f100e74cca5 None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:41.693749 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506ecb86-13a9-4468-bd4f-7f100e74cca5 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:41.694191 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506ecb86-13a9-4468-bd4f-7f100e74cca5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:41.695037 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506ecb86-13a9-4468-bd4f-7f100e74cca5 None admin] RBAC: Adding query filter params (interface=public, service_id=24e6e9d0f14f44d784bb3621d5fd578c, region_id=RegionOne) {{(pid=88081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:22:41.695491 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506ecb86-13a9-4468-bd4f-7f100e74cca5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:41.697019 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506ecb86-13a9-4468-bd4f-7f100e74cca5 None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:41.703608 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 389/783] 10.222.0.18 () {56 vars in 1251 bytes} [Sat Sep 24 19:22:41 2022] GET /identity/v3/endpoints?service_id=24e6e9d0f14f44d784bb3621d5fd578c&interface=public®ion_id=RegionOne => generated 194 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:22:41.709486 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4047d590-1f78-42fa-9a14-c9cb7fbbfa9f None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:41.830050 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4047d590-1f78-42fa-9a14-c9cb7fbbfa9f None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:41.855293 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:22:41.864575 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54922f8b-6f2d-4638-ab4f-7c0a0c9d892c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:41.865188 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54922f8b-6f2d-4638-ab4f-7c0a0c9d892c None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:41.865467 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54922f8b-6f2d-4638-ab4f-7c0a0c9d892c None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:41.865737 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54922f8b-6f2d-4638-ab4f-7c0a0c9d892c None admin] PATH_INFO: `/v3/services` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:41.866371 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54922f8b-6f2d-4638-ab4f-7c0a0c9d892c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:41.867730 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54922f8b-6f2d-4638-ab4f-7c0a0c9d892c None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:41.874151 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 395/784] 10.222.0.18 () {56 vars in 1087 bytes} [Sat Sep 24 19:22:41 2022] GET /identity/v3/services => generated 1498 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 19:22:42.587155 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375c9f24-91d5-4905-ad14-a9339e4b55e0 None None] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:42.587680 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375c9f24-91d5-4905-ad14-a9339e4b55e0 None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:42.587680 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375c9f24-91d5-4905-ad14-a9339e4b55e0 None None] PATH_INFO: `/` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:42.589676 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 390/785] 10.222.0.18 () {54 vars in 927 bytes} [Sat Sep 24 19:22:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:22:42.595075 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4913b143-d2b6-4e3f-b258-087e8c1d8e33 None None] REQUEST_METHOD: `POST` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:42.595323 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4913b143-d2b6-4e3f-b258-087e8c1d8e33 None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:42.595591 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4913b143-d2b6-4e3f-b258-087e8c1d8e33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:42.613766 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.auth.core [None req-4913b143-d2b6-4e3f-b258-087e8c1d8e33 None None] MFA Rules not processed for user `3dbbb9909cec43ff99c1c3682f016ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=88080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:22:42.614964 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.fernet_utils [None req-4913b143-d2b6-4e3f-b258-087e8c1d8e33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:22:42.680808 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 396/786] 10.222.0.18 () {58 vars in 1024 bytes} [Sat Sep 24 19:22:42 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 19:22:43.030865 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375c9f24-91d5-4905-ad14-a9339e4b55e0 None None] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:43.085621 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:22:43.137005 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375c9f24-91d5-4905-ad14-a9339e4b55e0 None None] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:43.173310 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db41184-d791-4f32-9d30-f8a8b5d5ba88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:43.174017 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db41184-d791-4f32-9d30-f8a8b5d5ba88 None admin] REQUEST_METHOD: `POST` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:43.174297 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db41184-d791-4f32-9d30-f8a8b5d5ba88 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:43.174568 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db41184-d791-4f32-9d30-f8a8b5d5ba88 None admin] PATH_INFO: `/v3/projects` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:43.175208 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db41184-d791-4f32-9d30-f8a8b5d5ba88 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:43.176621 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db41184-d791-4f32-9d30-f8a8b5d5ba88 None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:43.179308 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: WARNING keystone.server.flask.common [None req-9db41184-d791-4f32-9d30-f8a8b5d5ba88 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 24 19:22:43.199146 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.sql.core [None req-9db41184-d791-4f32-9d30-f8a8b5d5ba88 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 24 19:22:43.199146 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 24 19:22:43.199146 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [parameters: {'id': '50dd909f705e4ff496c45c8391695c69', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 24 19:22:43.199146 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=88081) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 24 19:22:43.216615 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application [None req-9db41184-d791-4f32-9d30-f8a8b5d5ba88 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 50dd909f705e4ff496c45c8391695c69.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 50dd909f705e4ff496c45c8391695c69. Sep 24 19:22:43.216615 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:22:43.216615 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 24 19:22:43.216615 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 24 19:22:43.216615 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 24 19:22:43.216615 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 24 19:22:43.216615 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 24 19:22:43.216615 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application result = self._query(query) Sep 24 19:22:43.216615 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 24 19:22:43.216615 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application conn.query(q) Sep 24 19:22:43.216615 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 24 19:22:43.216615 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 24 19:22:43.216615 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 24 19:22:43.217649 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application result.read() Sep 24 19:22:43.217649 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 24 19:22:43.217649 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 24 19:22:43.217649 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 24 19:22:43.217649 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 24 19:22:43.217649 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 24 19:22:43.217649 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 24 19:22:43.217649 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 24 19:22:43.217649 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 24 19:22:43.217649 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 24 19:22:43.217649 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Sep 24 19:22:43.217649 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 24 19:22:43.217649 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Sep 24 19:22:43.217649 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:22:43.217649 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 24 19:22:43.217649 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 24 19:22:43.217649 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Sep 24 19:22:43.217649 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return project_ref.to_dict() Sep 24 19:22:43.218682 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 24 19:22:43.218682 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application next(self.gen) Sep 24 19:22:43.218682 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 24 19:22:43.218682 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application yield resource Sep 24 19:22:43.218682 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 24 19:22:43.218682 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application next(self.gen) Sep 24 19:22:43.218682 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 24 19:22:43.218682 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application self.session.rollback() Sep 24 19:22:43.218682 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 24 19:22:43.218682 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application self.force_reraise() Sep 24 19:22:43.218682 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 24 19:22:43.218682 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application raise self.value Sep 24 19:22:43.218682 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 24 19:22:43.218682 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 24 19:22:43.218682 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 24 19:22:43.218682 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application session.commit() Sep 24 19:22:43.218682 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 24 19:22:43.219585 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 24 19:22:43.219585 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 24 19:22:43.219585 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application self._prepare_impl() Sep 24 19:22:43.219585 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 24 19:22:43.219585 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application self.session.flush() Sep 24 19:22:43.219585 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 24 19:22:43.219585 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application self._flush(objects) Sep 24 19:22:43.219585 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 24 19:22:43.219585 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 24 19:22:43.219585 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 24 19:22:43.219585 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application compat.raise_( Sep 24 19:22:43.219585 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 24 19:22:43.219585 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application raise exception Sep 24 19:22:43.219585 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 24 19:22:43.219585 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application flush_context.execute() Sep 24 19:22:43.219585 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 24 19:22:43.219585 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application rec.execute(self) Sep 24 19:22:43.220563 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 24 19:22:43.220563 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 24 19:22:43.220563 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 24 19:22:43.220563 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 24 19:22:43.220563 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 24 19:22:43.220563 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 24 19:22:43.220563 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 24 19:22:43.220563 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 24 19:22:43.220563 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 24 19:22:43.220563 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 24 19:22:43.220563 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 24 19:22:43.220563 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 24 19:22:43.220563 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 24 19:22:43.220563 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 24 19:22:43.220563 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 24 19:22:43.221387 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 24 19:22:43.221387 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 24 19:22:43.221387 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application raise exception Sep 24 19:22:43.221387 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 24 19:22:43.221387 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 24 19:22:43.221387 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 24 19:22:43.221387 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 24 19:22:43.221387 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 24 19:22:43.221387 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application result = self._query(query) Sep 24 19:22:43.221387 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 24 19:22:43.221387 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application conn.query(q) Sep 24 19:22:43.221387 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 24 19:22:43.221387 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 24 19:22:43.221387 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 24 19:22:43.221387 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application result.read() Sep 24 19:22:43.221387 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 24 19:22:43.221387 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 24 19:22:43.222302 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 24 19:22:43.222302 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 24 19:22:43.222302 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 24 19:22:43.222302 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 24 19:22:43.222302 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 24 19:22:43.222302 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 24 19:22:43.222302 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 24 19:22:43.222302 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 24 19:22:43.222302 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application [parameters: {'id': '50dd909f705e4ff496c45c8391695c69', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 24 19:22:43.222302 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 24 19:22:43.222302 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Sep 24 19:22:43.222302 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 24 19:22:43.222302 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Sep 24 19:22:43.222302 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:22:43.222302 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Sep 24 19:22:43.223097 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Sep 24 19:22:43.223097 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 24 19:22:43.223097 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 24 19:22:43.223097 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Sep 24 19:22:43.223097 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Sep 24 19:22:43.223097 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 24 19:22:43.223097 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Sep 24 19:22:43.223097 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:22:43.223097 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:22:43.223097 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:22:43.223097 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:22:43.223097 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:22:43.223097 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:22:43.223097 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:22:43.223097 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:22:43.223097 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:22:43.223097 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:22:43.224037 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:22:43.224037 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Sep 24 19:22:43.224037 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Sep 24 19:22:43.224037 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:22:43.224037 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:22:43.224037 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Sep 24 19:22:43.224037 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application raise exception.Conflict( Sep 24 19:22:43.224037 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 50dd909f705e4ff496c45c8391695c69. Sep 24 19:22:43.224037 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Sep 24 19:22:43.224037 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 391/787] 10.222.0.18 () {60 vars in 1140 bytes} [Sat Sep 24 19:22:43 2022] POST /identity/v3/projects => generated 262 bytes in 188 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:22:43.224664 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4913b143-d2b6-4e3f-b258-087e8c1d8e33 None None] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:43.341946 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4913b143-d2b6-4e3f-b258-087e8c1d8e33 None None] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:43.363791 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:22:43.378188 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326b14d6-57c6-425b-8b34-0aeaec5cf06c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:43.378818 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326b14d6-57c6-425b-8b34-0aeaec5cf06c None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:43.379099 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326b14d6-57c6-425b-8b34-0aeaec5cf06c None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:43.379372 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326b14d6-57c6-425b-8b34-0aeaec5cf06c None admin] PATH_INFO: `/v3/projects/service` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:43.386673 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326b14d6-57c6-425b-8b34-0aeaec5cf06c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:43.388120 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326b14d6-57c6-425b-8b34-0aeaec5cf06c None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:43.399467 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application [None req-326b14d6-57c6-425b-8b34-0aeaec5cf06c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 19:22:43.399467 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:22:43.399467 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:22:43.399467 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:22:43.399467 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:22:43.399467 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:22:43.399467 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:22:43.399467 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:22:43.399467 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:22:43.399467 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:22:43.399467 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:22:43.399467 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:22:43.399467 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 24 19:22:43.399467 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 24 19:22:43.399467 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 24 19:22:43.400481 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 24 19:22:43.400481 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:22:43.400481 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:22:43.400481 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:22:43.400481 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:22:43.400481 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:22:43.400481 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:22:43.400481 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:22:43.400481 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application with Lock( Sep 24 19:22:43.400481 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:22:43.400481 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:22:43.400481 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:22:43.400481 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:22:43.400481 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:22:43.400481 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:22:43.400481 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:22:43.400481 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:22:43.402469 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 24 19:22:43.402469 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 24 19:22:43.402469 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 24 19:22:43.402469 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 24 19:22:43.402469 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 24 19:22:43.402469 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 24 19:22:43.402469 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 19:22:43.402469 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Sep 24 19:22:43.402469 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 397/788] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Sep 24 19:22:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:22:43.407277 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db41184-d791-4f32-9d30-f8a8b5d5ba88 None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:43.516695 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db41184-d791-4f32-9d30-f8a8b5d5ba88 None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:43.527695 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:22:43.558960 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2e7cf9-71d5-4486-bb54-20f5d76c0a1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:43.558960 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2e7cf9-71d5-4486-bb54-20f5d76c0a1f None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:43.558960 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2e7cf9-71d5-4486-bb54-20f5d76c0a1f None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:43.558960 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2e7cf9-71d5-4486-bb54-20f5d76c0a1f None admin] PATH_INFO: `/v3/projects` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:43.559468 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2e7cf9-71d5-4486-bb54-20f5d76c0a1f None admin] RBAC: Adding query filter params (name=service) {{(pid=88081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:22:43.559468 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2e7cf9-71d5-4486-bb54-20f5d76c0a1f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:43.561040 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2e7cf9-71d5-4486-bb54-20f5d76c0a1f None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:43.582549 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 392/789] 10.222.0.18 () {56 vars in 1112 bytes} [Sat Sep 24 19:22:43 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:22:44.312371 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e4145d-ee54-461b-98c0-f4b7d826ecb0 None None] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:44.313232 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e4145d-ee54-461b-98c0-f4b7d826ecb0 None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:44.313232 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e4145d-ee54-461b-98c0-f4b7d826ecb0 None None] PATH_INFO: `/` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:44.314800 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 398/790] 10.222.0.18 () {54 vars in 927 bytes} [Sat Sep 24 19:22:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:22:44.321618 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f66b5db-acea-4db9-bbf3-e75b4f5d5e7a None None] REQUEST_METHOD: `POST` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:44.322158 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f66b5db-acea-4db9-bbf3-e75b4f5d5e7a None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:44.322270 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f66b5db-acea-4db9-bbf3-e75b4f5d5e7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:44.347715 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.auth.core [None req-5f66b5db-acea-4db9-bbf3-e75b4f5d5e7a None None] MFA Rules not processed for user `3dbbb9909cec43ff99c1c3682f016ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=88081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:22:44.349311 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.fernet_utils [None req-5f66b5db-acea-4db9-bbf3-e75b4f5d5e7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:22:44.429074 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 393/791] 10.222.0.18 () {58 vars in 1024 bytes} [Sat Sep 24 19:22:44 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 24 19:22:44.767275 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e4145d-ee54-461b-98c0-f4b7d826ecb0 None None] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:44.884178 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e4145d-ee54-461b-98c0-f4b7d826ecb0 None None] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:44.920079 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a43834a-70bc-47e4-aaa9-753320354ee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:44.920715 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a43834a-70bc-47e4-aaa9-753320354ee0 None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:44.920994 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a43834a-70bc-47e4-aaa9-753320354ee0 None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:44.921268 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a43834a-70bc-47e4-aaa9-753320354ee0 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:44.921885 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a43834a-70bc-47e4-aaa9-753320354ee0 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:44.923272 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a43834a-70bc-47e4-aaa9-753320354ee0 None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:44.933184 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application [None req-2a43834a-70bc-47e4-aaa9-753320354ee0 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 24 19:22:44.933184 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:22:44.933184 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 24 19:22:44.933184 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 24 19:22:44.933184 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 24 19:22:44.933184 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 24 19:22:44.933184 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 24 19:22:44.933184 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 19:22:44.933184 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 24 19:22:44.933184 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Sep 24 19:22:44.933184 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 24 19:22:44.933184 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Sep 24 19:22:44.933184 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:22:44.933184 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:22:44.933184 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:22:44.933184 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:22:44.934226 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:22:44.934226 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:22:44.934226 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:22:44.934226 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:22:44.934226 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:22:44.934226 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:22:44.934226 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:22:44.934226 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 24 19:22:44.934226 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 24 19:22:44.934226 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 24 19:22:44.934226 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 24 19:22:44.934226 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:22:44.934226 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:22:44.934226 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:22:44.934226 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:22:44.934226 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:22:44.934226 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:22:44.935151 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:22:44.935151 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application with Lock( Sep 24 19:22:44.935151 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:22:44.935151 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:22:44.935151 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:22:44.935151 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:22:44.935151 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:22:44.935151 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:22:44.935151 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:22:44.935151 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:22:44.935151 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 24 19:22:44.935151 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 19:22:44.935151 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 24 19:22:44.935151 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Sep 24 19:22:44.935151 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 399/792] 10.222.0.18 () {56 vars in 1132 bytes} [Sat Sep 24 19:22:44 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:22:44.943349 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f66b5db-acea-4db9-bbf3-e75b4f5d5e7a None None] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:45.044170 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:22:45.050964 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f66b5db-acea-4db9-bbf3-e75b4f5d5e7a None None] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:45.088564 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702c862a-b14d-4b95-a299-228e98600ba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:45.090069 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702c862a-b14d-4b95-a299-228e98600ba0 None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:45.090579 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702c862a-b14d-4b95-a299-228e98600ba0 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:45.091076 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702c862a-b14d-4b95-a299-228e98600ba0 None admin] PATH_INFO: `/v3/services` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:45.092281 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702c862a-b14d-4b95-a299-228e98600ba0 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=88081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:22:45.092598 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702c862a-b14d-4b95-a299-228e98600ba0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:45.094094 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702c862a-b14d-4b95-a299-228e98600ba0 None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:45.105889 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 394/793] 10.222.0.18 () {56 vars in 1126 bytes} [Sat Sep 24 19:22:44 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:22:45.111014 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a43834a-70bc-47e4-aaa9-753320354ee0 None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:45.161749 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:22:45.235352 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a43834a-70bc-47e4-aaa9-753320354ee0 None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:45.283225 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca62030-cbb0-4feb-82d1-2dc5987f775c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:45.283868 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca62030-cbb0-4feb-82d1-2dc5987f775c None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:45.284128 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca62030-cbb0-4feb-82d1-2dc5987f775c None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:45.284399 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca62030-cbb0-4feb-82d1-2dc5987f775c None admin] PATH_INFO: `/v3/services` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:45.285061 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca62030-cbb0-4feb-82d1-2dc5987f775c None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=88080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:22:45.285362 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca62030-cbb0-4feb-82d1-2dc5987f775c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:45.286833 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca62030-cbb0-4feb-82d1-2dc5987f775c None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:45.293450 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 400/794] 10.222.0.18 () {56 vars in 1126 bytes} [Sat Sep 24 19:22:45 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:22:45.299825 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702c862a-b14d-4b95-a299-228e98600ba0 None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:45.405475 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702c862a-b14d-4b95-a299-228e98600ba0 None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:45.452614 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d618fd4e-a66a-4cc3-9a99-0e3fa4c1a058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:45.453392 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d618fd4e-a66a-4cc3-9a99-0e3fa4c1a058 None admin] REQUEST_METHOD: `POST` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:45.453762 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d618fd4e-a66a-4cc3-9a99-0e3fa4c1a058 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:45.454170 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d618fd4e-a66a-4cc3-9a99-0e3fa4c1a058 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:45.454996 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d618fd4e-a66a-4cc3-9a99-0e3fa4c1a058 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:45.456514 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d618fd4e-a66a-4cc3-9a99-0e3fa4c1a058 None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:45.488767 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 395/795] 10.222.0.18 () {60 vars in 1144 bytes} [Sat Sep 24 19:22:45 2022] POST /identity/v3/endpoints => generated 347 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 24 19:22:46.167456 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084daaf1-f3cb-4a1a-9382-eaa8980694d4 None None] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:46.168092 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084daaf1-f3cb-4a1a-9382-eaa8980694d4 None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:46.168092 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084daaf1-f3cb-4a1a-9382-eaa8980694d4 None None] PATH_INFO: `/` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:46.169388 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 401/796] 10.222.0.18 () {54 vars in 927 bytes} [Sat Sep 24 19:22:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:22:46.175766 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f806da7-9b34-4bcc-84a2-31dd0de25aa5 None None] REQUEST_METHOD: `POST` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:46.176043 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f806da7-9b34-4bcc-84a2-31dd0de25aa5 None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:46.176312 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f806da7-9b34-4bcc-84a2-31dd0de25aa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:46.196800 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.auth.core [None req-3f806da7-9b34-4bcc-84a2-31dd0de25aa5 None None] MFA Rules not processed for user `3dbbb9909cec43ff99c1c3682f016ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=88081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:22:46.198637 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.fernet_utils [None req-3f806da7-9b34-4bcc-84a2-31dd0de25aa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:22:46.212139 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:22:46.281541 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 396/797] 10.222.0.18 () {58 vars in 1024 bytes} [Sat Sep 24 19:22:46 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 19:22:46.606806 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084daaf1-f3cb-4a1a-9382-eaa8980694d4 None None] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:46.719245 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084daaf1-f3cb-4a1a-9382-eaa8980694d4 None None] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:46.729068 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:22:46.757681 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4bb92c-2d1a-42f1-ba5f-71c73f52b402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:46.757681 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4bb92c-2d1a-42f1-ba5f-71c73f52b402 None admin] REQUEST_METHOD: `POST` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:46.757681 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4bb92c-2d1a-42f1-ba5f-71c73f52b402 None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:46.757681 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4bb92c-2d1a-42f1-ba5f-71c73f52b402 None admin] PATH_INFO: `/v3/users` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:46.758245 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4bb92c-2d1a-42f1-ba5f-71c73f52b402 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:46.759499 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4bb92c-2d1a-42f1-ba5f-71c73f52b402 None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:46.762138 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: WARNING keystone.server.flask.common [None req-ed4bb92c-2d1a-42f1-ba5f-71c73f52b402 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 24 19:22:46.777351 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.sql.core [None req-ed4bb92c-2d1a-42f1-ba5f-71c73f52b402 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 24 19:22:46.777351 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 24 19:22:46.777351 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [parameters: {'user_id': '91c01b4348414b299280581a78f80f2e', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 24 19:22:46.777351 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=88080) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 24 19:22:46.794300 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application [None req-ed4bb92c-2d1a-42f1-ba5f-71c73f52b402 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 24 19:22:46.794300 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:22:46.794300 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 24 19:22:46.794300 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 24 19:22:46.794300 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 24 19:22:46.794300 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 24 19:22:46.794300 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 24 19:22:46.794300 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application result = self._query(query) Sep 24 19:22:46.794300 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 24 19:22:46.794300 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application conn.query(q) Sep 24 19:22:46.794300 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 24 19:22:46.794300 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 24 19:22:46.794300 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 24 19:22:46.794300 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application result.read() Sep 24 19:22:46.794300 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 24 19:22:46.795348 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 24 19:22:46.795348 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 24 19:22:46.795348 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 24 19:22:46.795348 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 24 19:22:46.795348 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 24 19:22:46.795348 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 24 19:22:46.795348 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 24 19:22:46.795348 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 24 19:22:46.795348 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Sep 24 19:22:46.795348 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 24 19:22:46.795348 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Sep 24 19:22:46.795348 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:22:46.795348 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 24 19:22:46.795348 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 24 19:22:46.795348 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Sep 24 19:22:46.795348 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Sep 24 19:22:46.795348 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 24 19:22:46.795348 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application next(self.gen) Sep 24 19:22:46.797507 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 24 19:22:46.797507 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application yield resource Sep 24 19:22:46.797507 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 24 19:22:46.797507 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application next(self.gen) Sep 24 19:22:46.797507 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 24 19:22:46.797507 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application self.session.rollback() Sep 24 19:22:46.797507 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 24 19:22:46.797507 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application self.force_reraise() Sep 24 19:22:46.797507 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 24 19:22:46.797507 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application raise self.value Sep 24 19:22:46.797507 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 24 19:22:46.797507 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 24 19:22:46.797507 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 24 19:22:46.797507 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application session.commit() Sep 24 19:22:46.797507 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 24 19:22:46.797507 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 24 19:22:46.797507 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 24 19:22:46.799506 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application self._prepare_impl() Sep 24 19:22:46.799506 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 24 19:22:46.799506 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application self.session.flush() Sep 24 19:22:46.799506 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 24 19:22:46.799506 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application self._flush(objects) Sep 24 19:22:46.799506 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 24 19:22:46.799506 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 24 19:22:46.799506 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 24 19:22:46.799506 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application compat.raise_( Sep 24 19:22:46.799506 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 24 19:22:46.799506 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application raise exception Sep 24 19:22:46.799506 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 24 19:22:46.799506 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application flush_context.execute() Sep 24 19:22:46.799506 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 24 19:22:46.799506 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application rec.execute(self) Sep 24 19:22:46.799506 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 24 19:22:46.799506 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 24 19:22:46.802075 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 24 19:22:46.802075 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 24 19:22:46.802075 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 24 19:22:46.802075 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application result = connection._execute_20( Sep 24 19:22:46.802075 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 24 19:22:46.802075 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 24 19:22:46.802075 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 24 19:22:46.802075 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 24 19:22:46.802075 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 24 19:22:46.802075 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 24 19:22:46.802075 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 24 19:22:46.802075 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 24 19:22:46.802075 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 24 19:22:46.802075 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 24 19:22:46.802075 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 24 19:22:46.802075 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application raise exception Sep 24 19:22:46.804335 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 24 19:22:46.804335 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 24 19:22:46.804335 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 24 19:22:46.804335 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 24 19:22:46.804335 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 24 19:22:46.804335 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application result = self._query(query) Sep 24 19:22:46.804335 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 24 19:22:46.804335 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application conn.query(q) Sep 24 19:22:46.804335 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 24 19:22:46.804335 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 24 19:22:46.804335 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 24 19:22:46.804335 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application result.read() Sep 24 19:22:46.804335 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 24 19:22:46.804335 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 24 19:22:46.804335 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 24 19:22:46.804335 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 24 19:22:46.805957 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 24 19:22:46.805957 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 24 19:22:46.805957 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 24 19:22:46.805957 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 24 19:22:46.805957 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 24 19:22:46.805957 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 24 19:22:46.805957 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application [parameters: {'user_id': '91c01b4348414b299280581a78f80f2e', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 24 19:22:46.805957 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 24 19:22:46.805957 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Sep 24 19:22:46.805957 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 24 19:22:46.805957 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Sep 24 19:22:46.805957 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:22:46.805957 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:22:46.805957 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:22:46.805957 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:22:46.807611 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:22:46.807611 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:22:46.807611 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:22:46.807611 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:22:46.807611 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:22:46.807611 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:22:46.807611 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:22:46.807611 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Sep 24 19:22:46.807611 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Sep 24 19:22:46.807611 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:22:46.807611 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:22:46.807611 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 24 19:22:46.807611 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 19:22:46.807611 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 24 19:22:46.807611 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 19:22:46.807611 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Sep 24 19:22:46.807611 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Sep 24 19:22:46.809492 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Sep 24 19:22:46.809492 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Sep 24 19:22:46.809492 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 24 19:22:46.809492 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 24 19:22:46.809492 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 24 19:22:46.809492 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Sep 24 19:22:46.809492 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 402/798] 10.222.0.18 () {60 vars in 1131 bytes} [Sat Sep 24 19:22:46 2022] POST /identity/v3/users => generated 160 bytes in 189 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:22:46.810229 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f806da7-9b34-4bcc-84a2-31dd0de25aa5 None None] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:46.938103 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f806da7-9b34-4bcc-84a2-31dd0de25aa5 None None] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:46.981009 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b204cc0-3857-4c47-9c77-7a6fa8d0297b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:46.981669 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b204cc0-3857-4c47-9c77-7a6fa8d0297b None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:46.981982 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b204cc0-3857-4c47-9c77-7a6fa8d0297b None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:46.982261 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b204cc0-3857-4c47-9c77-7a6fa8d0297b None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:46.990712 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b204cc0-3857-4c47-9c77-7a6fa8d0297b None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:46.992170 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b204cc0-3857-4c47-9c77-7a6fa8d0297b None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:47.004963 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application [None req-9b204cc0-3857-4c47-9c77-7a6fa8d0297b None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 24 19:22:47.004963 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:22:47.004963 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:22:47.004963 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:22:47.004963 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:22:47.004963 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:22:47.004963 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:22:47.004963 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:22:47.004963 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:22:47.004963 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:22:47.004963 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:22:47.004963 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:22:47.004963 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 24 19:22:47.004963 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 24 19:22:47.004963 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 24 19:22:47.004963 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 24 19:22:47.006135 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:22:47.006135 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:22:47.006135 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 24 19:22:47.006135 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 19:22:47.006135 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 24 19:22:47.006135 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 19:22:47.006135 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:22:47.006135 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:22:47.006135 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:22:47.006135 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:22:47.006135 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:22:47.006135 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application with Lock( Sep 24 19:22:47.006135 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:22:47.006135 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:22:47.006135 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:22:47.006135 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:22:47.006135 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:22:47.006135 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:22:47.007243 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:22:47.007243 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:22:47.007243 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 24 19:22:47.007243 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 24 19:22:47.007243 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 24 19:22:47.007243 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 24 19:22:47.007243 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 24 19:22:47.007243 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 24 19:22:47.007243 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 24 19:22:47.007243 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Sep 24 19:22:47.007243 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 397/799] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Sep 24 19:22:46 2022] GET /identity/v3/users/cinder => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:22:47.012973 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4bb92c-2d1a-42f1-ba5f-71c73f52b402 None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:47.118593 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4bb92c-2d1a-42f1-ba5f-71c73f52b402 None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:47.158304 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bce3c5-788f-4bf6-83ac-36d589a2b40a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:47.158925 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bce3c5-788f-4bf6-83ac-36d589a2b40a None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:47.159202 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bce3c5-788f-4bf6-83ac-36d589a2b40a None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:47.159475 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bce3c5-788f-4bf6-83ac-36d589a2b40a None admin] PATH_INFO: `/v3/users` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:47.160215 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bce3c5-788f-4bf6-83ac-36d589a2b40a None admin] RBAC: Adding query filter params (name=cinder) {{(pid=88080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:22:47.160521 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bce3c5-788f-4bf6-83ac-36d589a2b40a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:47.162293 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bce3c5-788f-4bf6-83ac-36d589a2b40a None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:47.207893 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 403/800] 10.222.0.18 () {56 vars in 1101 bytes} [Sat Sep 24 19:22:47 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:22:48.035859 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28fe740-8e8e-45a8-8830-f764370143bb None None] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:48.036372 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28fe740-8e8e-45a8-8830-f764370143bb None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:48.036372 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28fe740-8e8e-45a8-8830-f764370143bb None None] PATH_INFO: `/` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:48.037789 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 398/801] 10.222.0.18 () {54 vars in 927 bytes} [Sat Sep 24 19:22:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:22:48.044027 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de78850f-8c86-47c0-a083-b98207a5df81 None None] REQUEST_METHOD: `POST` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:48.044310 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de78850f-8c86-47c0-a083-b98207a5df81 None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:48.044590 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de78850f-8c86-47c0-a083-b98207a5df81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:48.064278 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.auth.core [None req-de78850f-8c86-47c0-a083-b98207a5df81 None None] MFA Rules not processed for user `3dbbb9909cec43ff99c1c3682f016ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=88080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:22:48.065946 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.fernet_utils [None req-de78850f-8c86-47c0-a083-b98207a5df81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:22:48.095874 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:22:48.150107 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 404/802] 10.222.0.18 () {58 vars in 1024 bytes} [Sat Sep 24 19:22:48 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 19:22:48.477655 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28fe740-8e8e-45a8-8830-f764370143bb None None] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:48.481134 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:22:48.593103 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28fe740-8e8e-45a8-8830-f764370143bb None None] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:48.629957 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dab1cb-2ba1-4420-a1e7-7212ff05e6e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:48.630581 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dab1cb-2ba1-4420-a1e7-7212ff05e6e8 None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:48.630855 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dab1cb-2ba1-4420-a1e7-7212ff05e6e8 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:48.631119 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dab1cb-2ba1-4420-a1e7-7212ff05e6e8 None admin] PATH_INFO: `/v3/services/compute` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:48.631718 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dab1cb-2ba1-4420-a1e7-7212ff05e6e8 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:48.633078 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dab1cb-2ba1-4420-a1e7-7212ff05e6e8 None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:48.642898 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application [None req-57dab1cb-2ba1-4420-a1e7-7212ff05e6e8 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 24 19:22:48.642898 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:22:48.642898 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 24 19:22:48.642898 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 24 19:22:48.642898 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 24 19:22:48.642898 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 24 19:22:48.642898 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 24 19:22:48.642898 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 19:22:48.642898 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 24 19:22:48.642898 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Sep 24 19:22:48.642898 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 24 19:22:48.642898 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Sep 24 19:22:48.642898 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:22:48.642898 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:22:48.642898 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:22:48.642898 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:22:48.642898 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:22:48.644022 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:22:48.644022 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:22:48.644022 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:22:48.644022 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:22:48.644022 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:22:48.644022 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:22:48.644022 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 24 19:22:48.644022 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 24 19:22:48.644022 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 24 19:22:48.644022 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 24 19:22:48.644022 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:22:48.644022 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:22:48.644022 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:22:48.644022 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:22:48.644022 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:22:48.644022 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:22:48.644856 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:22:48.644856 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application with Lock( Sep 24 19:22:48.644856 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:22:48.644856 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:22:48.644856 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:22:48.644856 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:22:48.644856 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:22:48.644856 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:22:48.644856 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:22:48.644856 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:22:48.644856 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 24 19:22:48.644856 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 19:22:48.644856 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 24 19:22:48.644856 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Sep 24 19:22:48.644856 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 399/803] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Sep 24 19:22:48 2022] GET /identity/v3/services/compute => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:22:48.652311 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de78850f-8c86-47c0-a083-b98207a5df81 None None] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:48.769653 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de78850f-8c86-47c0-a083-b98207a5df81 None None] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:48.808798 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c41f61-802c-4648-ae7c-d5f1a6cf55a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:48.809475 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c41f61-802c-4648-ae7c-d5f1a6cf55a8 None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:48.809811 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c41f61-802c-4648-ae7c-d5f1a6cf55a8 None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:48.810117 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c41f61-802c-4648-ae7c-d5f1a6cf55a8 None admin] PATH_INFO: `/v3/services` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:48.810751 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c41f61-802c-4648-ae7c-d5f1a6cf55a8 None admin] RBAC: Adding query filter params (name=compute) {{(pid=88080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:22:48.811051 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c41f61-802c-4648-ae7c-d5f1a6cf55a8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:48.812409 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c41f61-802c-4648-ae7c-d5f1a6cf55a8 None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:48.817747 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 405/804] 10.222.0.18 () {56 vars in 1112 bytes} [Sat Sep 24 19:22:48 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:22:48.824384 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dab1cb-2ba1-4420-a1e7-7212ff05e6e8 None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:48.941097 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:22:48.990608 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dab1cb-2ba1-4420-a1e7-7212ff05e6e8 None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:49.049099 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371ce3c8-7c39-449c-94a5-13e89b63eed8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:49.049934 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371ce3c8-7c39-449c-94a5-13e89b63eed8 None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:49.050334 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371ce3c8-7c39-449c-94a5-13e89b63eed8 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:49.050648 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371ce3c8-7c39-449c-94a5-13e89b63eed8 None admin] PATH_INFO: `/v3/services` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:49.051442 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371ce3c8-7c39-449c-94a5-13e89b63eed8 None admin] RBAC: Adding query filter params (type=compute) {{(pid=88081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:22:49.051803 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371ce3c8-7c39-449c-94a5-13e89b63eed8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:49.053400 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371ce3c8-7c39-449c-94a5-13e89b63eed8 None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:49.059853 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 400/805] 10.222.0.18 () {56 vars in 1112 bytes} [Sat Sep 24 19:22:48 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:22:51.514505 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5065e99-0a59-40b1-9669-e51a2dafe444 None None] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:51.515406 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5065e99-0a59-40b1-9669-e51a2dafe444 None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:51.515406 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5065e99-0a59-40b1-9669-e51a2dafe444 None None] PATH_INFO: `/` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:51.516864 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 406/806] 10.222.0.18 () {54 vars in 927 bytes} [Sat Sep 24 19:22:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:22:51.522360 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab913ed-d8ca-4cc0-999e-5ddf4efaf570 None None] REQUEST_METHOD: `POST` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:51.523062 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab913ed-d8ca-4cc0-999e-5ddf4efaf570 None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:51.523062 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab913ed-d8ca-4cc0-999e-5ddf4efaf570 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:51.544447 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.auth.core [None req-eab913ed-d8ca-4cc0-999e-5ddf4efaf570 None None] MFA Rules not processed for user `3dbbb9909cec43ff99c1c3682f016ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=88081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:22:51.546038 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.fernet_utils [None req-eab913ed-d8ca-4cc0-999e-5ddf4efaf570 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:22:51.631179 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 401/807] 10.222.0.18 () {58 vars in 1024 bytes} [Sat Sep 24 19:22:51 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 19:22:51.979341 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5065e99-0a59-40b1-9669-e51a2dafe444 None None] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:52.008065 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:22:52.099605 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5065e99-0a59-40b1-9669-e51a2dafe444 None None] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:52.139604 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac368917-4abb-4b1a-bd92-f43e09acb95b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:52.140238 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac368917-4abb-4b1a-bd92-f43e09acb95b None admin] REQUEST_METHOD: `POST` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:52.140516 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac368917-4abb-4b1a-bd92-f43e09acb95b None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:52.140787 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac368917-4abb-4b1a-bd92-f43e09acb95b None admin] PATH_INFO: `/v3/services` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:52.141444 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac368917-4abb-4b1a-bd92-f43e09acb95b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:52.142856 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac368917-4abb-4b1a-bd92-f43e09acb95b None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:52.161122 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 407/808] 10.222.0.18 () {60 vars in 1141 bytes} [Sat Sep 24 19:22:51 2022] POST /identity/v3/services => generated 242 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:22:54.833682 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7232d39f-c903-49fd-bb51-651de96759e6 None None] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:54.834323 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7232d39f-c903-49fd-bb51-651de96759e6 None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:54.834323 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7232d39f-c903-49fd-bb51-651de96759e6 None None] PATH_INFO: `/` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:54.835785 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 402/809] 10.222.0.18 () {54 vars in 927 bytes} [Sat Sep 24 19:22:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:22:54.841735 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721d5a87-a547-40c2-8c3a-ae953a1d9aa8 None None] REQUEST_METHOD: `POST` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:54.842313 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721d5a87-a547-40c2-8c3a-ae953a1d9aa8 None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:54.842313 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721d5a87-a547-40c2-8c3a-ae953a1d9aa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:54.860715 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.auth.core [None req-721d5a87-a547-40c2-8c3a-ae953a1d9aa8 None None] MFA Rules not processed for user `3dbbb9909cec43ff99c1c3682f016ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=88080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:22:54.862288 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.fernet_utils [None req-721d5a87-a547-40c2-8c3a-ae953a1d9aa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:22:54.944035 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 408/810] 10.222.0.18 () {58 vars in 1024 bytes} [Sat Sep 24 19:22:54 2022] POST /identity/v3/auth/tokens => generated 1713 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 19:22:55.313406 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7232d39f-c903-49fd-bb51-651de96759e6 None None] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:55.382253 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:22:55.429620 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7232d39f-c903-49fd-bb51-651de96759e6 None None] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:55.469084 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dffa975-80ec-467e-8fec-a6f66ca6f838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:55.469786 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dffa975-80ec-467e-8fec-a6f66ca6f838 None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:55.470091 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dffa975-80ec-467e-8fec-a6f66ca6f838 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:55.470385 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dffa975-80ec-467e-8fec-a6f66ca6f838 None admin] PATH_INFO: `/v3/services/compute` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:55.471039 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dffa975-80ec-467e-8fec-a6f66ca6f838 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:55.472573 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dffa975-80ec-467e-8fec-a6f66ca6f838 None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:55.482697 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application [None req-8dffa975-80ec-467e-8fec-a6f66ca6f838 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 24 19:22:55.482697 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:22:55.482697 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 24 19:22:55.482697 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 24 19:22:55.482697 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 24 19:22:55.482697 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 24 19:22:55.482697 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 24 19:22:55.482697 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 19:22:55.482697 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 24 19:22:55.482697 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Sep 24 19:22:55.482697 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 24 19:22:55.482697 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Sep 24 19:22:55.482697 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:22:55.482697 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:22:55.482697 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:22:55.482697 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:22:55.482697 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:22:55.483876 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:22:55.483876 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:22:55.483876 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:22:55.483876 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:22:55.483876 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:22:55.483876 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:22:55.483876 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 24 19:22:55.483876 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 24 19:22:55.483876 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 24 19:22:55.483876 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 24 19:22:55.483876 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:22:55.483876 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:22:55.483876 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:22:55.483876 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:22:55.483876 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:22:55.483876 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:22:55.484833 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:22:55.484833 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application with Lock( Sep 24 19:22:55.484833 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:22:55.484833 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:22:55.484833 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:22:55.484833 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:22:55.484833 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:22:55.484833 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:22:55.484833 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:22:55.484833 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:22:55.484833 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 24 19:22:55.484833 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 19:22:55.484833 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 24 19:22:55.484833 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Sep 24 19:22:55.484833 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 403/811] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Sep 24 19:22:55 2022] GET /identity/v3/services/compute => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:22:55.491087 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721d5a87-a547-40c2-8c3a-ae953a1d9aa8 None None] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:55.502130 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:22:55.599347 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721d5a87-a547-40c2-8c3a-ae953a1d9aa8 None None] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:55.646703 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7930c48-72ad-4739-bfc1-c25d0c18f69b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:55.647337 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7930c48-72ad-4739-bfc1-c25d0c18f69b None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:55.647611 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7930c48-72ad-4739-bfc1-c25d0c18f69b None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:55.647874 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7930c48-72ad-4739-bfc1-c25d0c18f69b None admin] PATH_INFO: `/v3/services` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:55.648532 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7930c48-72ad-4739-bfc1-c25d0c18f69b None admin] RBAC: Adding query filter params (name=compute) {{(pid=88080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:22:55.648827 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7930c48-72ad-4739-bfc1-c25d0c18f69b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:55.650312 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7930c48-72ad-4739-bfc1-c25d0c18f69b None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:55.656263 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 409/812] 10.222.0.18 () {56 vars in 1112 bytes} [Sat Sep 24 19:22:55 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:22:55.662659 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dffa975-80ec-467e-8fec-a6f66ca6f838 None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:55.784378 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dffa975-80ec-467e-8fec-a6f66ca6f838 None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:55.815345 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:22:55.828481 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65a1bc1-9fd0-45f9-beeb-8811ffb52cb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:55.829169 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65a1bc1-9fd0-45f9-beeb-8811ffb52cb3 None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:55.829466 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65a1bc1-9fd0-45f9-beeb-8811ffb52cb3 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:55.829873 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65a1bc1-9fd0-45f9-beeb-8811ffb52cb3 None admin] PATH_INFO: `/v3/services` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:55.830585 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65a1bc1-9fd0-45f9-beeb-8811ffb52cb3 None admin] RBAC: Adding query filter params (type=compute) {{(pid=88081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:22:55.830894 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65a1bc1-9fd0-45f9-beeb-8811ffb52cb3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:55.832477 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65a1bc1-9fd0-45f9-beeb-8811ffb52cb3 None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:55.838845 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 404/813] 10.222.0.18 () {56 vars in 1112 bytes} [Sat Sep 24 19:22:55 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:22:55.848517 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7930c48-72ad-4739-bfc1-c25d0c18f69b None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:55.958004 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:22:55.997083 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7930c48-72ad-4739-bfc1-c25d0c18f69b None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:56.034713 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72a9e73-470f-4b69-bb10-b931bf785a5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:56.035326 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72a9e73-470f-4b69-bb10-b931bf785a5a None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:56.035598 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72a9e73-470f-4b69-bb10-b931bf785a5a None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:56.035861 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72a9e73-470f-4b69-bb10-b931bf785a5a None admin] PATH_INFO: `/v3/endpoints` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:56.036578 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72a9e73-470f-4b69-bb10-b931bf785a5a None admin] RBAC: Adding query filter params (interface=public, service_id=161c51035a88415c8baef933ac0ed955, region_id=RegionOne) {{(pid=88080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:22:56.036881 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72a9e73-470f-4b69-bb10-b931bf785a5a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:56.038342 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72a9e73-470f-4b69-bb10-b931bf785a5a None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:56.044894 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 410/814] 10.222.0.18 () {56 vars in 1251 bytes} [Sat Sep 24 19:22:55 2022] GET /identity/v3/endpoints?service_id=161c51035a88415c8baef933ac0ed955&interface=public®ion_id=RegionOne => generated 194 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:22:56.051111 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65a1bc1-9fd0-45f9-beeb-8811ffb52cb3 None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:56.164855 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65a1bc1-9fd0-45f9-beeb-8811ffb52cb3 None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:56.207436 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c481b953-7e80-49e5-89cc-1c84926a3046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:56.208396 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c481b953-7e80-49e5-89cc-1c84926a3046 None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:56.208703 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c481b953-7e80-49e5-89cc-1c84926a3046 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:56.209022 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c481b953-7e80-49e5-89cc-1c84926a3046 None admin] PATH_INFO: `/v3/services` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:56.209911 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c481b953-7e80-49e5-89cc-1c84926a3046 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:56.211724 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c481b953-7e80-49e5-89cc-1c84926a3046 None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:56.219267 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 405/815] 10.222.0.18 () {56 vars in 1087 bytes} [Sat Sep 24 19:22:56 2022] GET /identity/v3/services => generated 1728 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 24 19:22:58.677576 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e856bc-987c-4d3e-a422-6ce15a89370e None None] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:58.678208 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e856bc-987c-4d3e-a422-6ce15a89370e None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:58.678342 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e856bc-987c-4d3e-a422-6ce15a89370e None None] PATH_INFO: `/` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:58.680053 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 411/816] 10.222.0.18 () {54 vars in 927 bytes} [Sat Sep 24 19:22:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:22:58.685901 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7e373a-b858-48b5-a030-380698de4136 None None] REQUEST_METHOD: `POST` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:58.686340 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7e373a-b858-48b5-a030-380698de4136 None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:58.686435 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7e373a-b858-48b5-a030-380698de4136 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:58.704622 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.auth.core [None req-6b7e373a-b858-48b5-a030-380698de4136 None None] MFA Rules not processed for user `3dbbb9909cec43ff99c1c3682f016ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=88081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:22:58.705778 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.fernet_utils [None req-6b7e373a-b858-48b5-a030-380698de4136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:22:58.752041 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:22:58.772929 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 406/817] 10.222.0.18 () {58 vars in 1024 bytes} [Sat Sep 24 19:22:58 2022] POST /identity/v3/auth/tokens => generated 1713 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 19:22:59.090304 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e856bc-987c-4d3e-a422-6ce15a89370e None None] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:59.190405 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e856bc-987c-4d3e-a422-6ce15a89370e None None] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:59.231676 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c18b5f1-995f-4deb-bf92-13f8d7e5aa34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:59.232336 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c18b5f1-995f-4deb-bf92-13f8d7e5aa34 None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:59.232658 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c18b5f1-995f-4deb-bf92-13f8d7e5aa34 None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:59.232930 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c18b5f1-995f-4deb-bf92-13f8d7e5aa34 None admin] PATH_INFO: `/v3/services/compute` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:59.233623 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c18b5f1-995f-4deb-bf92-13f8d7e5aa34 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:59.235326 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c18b5f1-995f-4deb-bf92-13f8d7e5aa34 None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:59.238649 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:22:59.247682 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application [None req-8c18b5f1-995f-4deb-bf92-13f8d7e5aa34 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 24 19:22:59.247682 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:22:59.247682 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 24 19:22:59.247682 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 24 19:22:59.247682 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 24 19:22:59.247682 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 24 19:22:59.247682 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 24 19:22:59.247682 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 19:22:59.247682 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 24 19:22:59.247682 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Sep 24 19:22:59.247682 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 24 19:22:59.247682 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Sep 24 19:22:59.247682 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:22:59.247682 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:22:59.247682 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:22:59.247682 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:22:59.247682 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:22:59.248836 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:22:59.248836 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:22:59.248836 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:22:59.248836 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:22:59.248836 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:22:59.248836 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:22:59.248836 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 24 19:22:59.248836 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 24 19:22:59.248836 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 24 19:22:59.248836 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 24 19:22:59.248836 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:22:59.248836 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:22:59.248836 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:22:59.248836 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:22:59.248836 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:22:59.248836 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:22:59.249790 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:22:59.249790 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application with Lock( Sep 24 19:22:59.249790 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:22:59.249790 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:22:59.249790 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:22:59.249790 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:22:59.249790 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:22:59.249790 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:22:59.249790 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:22:59.249790 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:22:59.249790 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 24 19:22:59.249790 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 19:22:59.249790 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 24 19:22:59.249790 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Sep 24 19:22:59.249790 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 412/818] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Sep 24 19:22:59 2022] GET /identity/v3/services/compute => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:22:59.258196 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7e373a-b858-48b5-a030-380698de4136 None None] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:59.363695 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7e373a-b858-48b5-a030-380698de4136 None None] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:59.397793 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1109aa8-6ae2-4649-b2f6-a2b024620eee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:59.398453 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1109aa8-6ae2-4649-b2f6-a2b024620eee None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:59.398731 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1109aa8-6ae2-4649-b2f6-a2b024620eee None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:59.399000 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1109aa8-6ae2-4649-b2f6-a2b024620eee None admin] PATH_INFO: `/v3/services` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:59.399641 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1109aa8-6ae2-4649-b2f6-a2b024620eee None admin] RBAC: Adding query filter params (name=compute) {{(pid=88081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:22:59.399979 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1109aa8-6ae2-4649-b2f6-a2b024620eee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:59.401371 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1109aa8-6ae2-4649-b2f6-a2b024620eee None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:59.406952 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 407/819] 10.222.0.18 () {56 vars in 1112 bytes} [Sat Sep 24 19:22:59 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:22:59.413087 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c18b5f1-995f-4deb-bf92-13f8d7e5aa34 None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:59.520795 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c18b5f1-995f-4deb-bf92-13f8d7e5aa34 None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:59.553236 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2886c851-60c5-41fe-a4c5-ce741c6f203a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:59.553925 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2886c851-60c5-41fe-a4c5-ce741c6f203a None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:59.554150 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2886c851-60c5-41fe-a4c5-ce741c6f203a None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:59.554424 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2886c851-60c5-41fe-a4c5-ce741c6f203a None admin] PATH_INFO: `/v3/services` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:59.555053 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2886c851-60c5-41fe-a4c5-ce741c6f203a None admin] RBAC: Adding query filter params (type=compute) {{(pid=88080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:22:59.555352 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2886c851-60c5-41fe-a4c5-ce741c6f203a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:59.557252 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2886c851-60c5-41fe-a4c5-ce741c6f203a None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:59.562194 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 413/820] 10.222.0.18 () {56 vars in 1112 bytes} [Sat Sep 24 19:22:59 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:22:59.568978 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1109aa8-6ae2-4649-b2f6-a2b024620eee None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:22:59.615465 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:22:59.668671 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1109aa8-6ae2-4649-b2f6-a2b024620eee None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:22:59.702014 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9075396e-a71c-4fdb-bbd2-fc4f7047cbe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:22:59.702653 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9075396e-a71c-4fdb-bbd2-fc4f7047cbe7 None admin] REQUEST_METHOD: `POST` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:22:59.702882 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9075396e-a71c-4fdb-bbd2-fc4f7047cbe7 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:22:59.703152 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9075396e-a71c-4fdb-bbd2-fc4f7047cbe7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:22:59.703811 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9075396e-a71c-4fdb-bbd2-fc4f7047cbe7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:22:59.705212 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9075396e-a71c-4fdb-bbd2-fc4f7047cbe7 None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:22:59.724628 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 408/821] 10.222.0.18 () {60 vars in 1144 bytes} [Sat Sep 24 19:22:59 2022] POST /identity/v3/endpoints => generated 334 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:23:09.559815 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=68 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:23:09.720529 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=48,keystone:INSERT=1 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:24:04.955257 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1027615f-3980-475a-9735-baaf92f80dfd None None] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:24:04.956743 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1027615f-3980-475a-9735-baaf92f80dfd None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:24:04.956743 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1027615f-3980-475a-9735-baaf92f80dfd None None] PATH_INFO: `/` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:24:04.957991 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 414/822] 10.222.0.18 () {54 vars in 927 bytes} [Sat Sep 24 19:24:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:24:04.965191 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ee73b2-77cb-4880-b5f8-47ee0e9bbaf3 None None] REQUEST_METHOD: `POST` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:24:04.966117 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ee73b2-77cb-4880-b5f8-47ee0e9bbaf3 None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:24:04.966353 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ee73b2-77cb-4880-b5f8-47ee0e9bbaf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:24:04.994106 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.auth.core [None req-07ee73b2-77cb-4880-b5f8-47ee0e9bbaf3 None None] MFA Rules not processed for user `3dbbb9909cec43ff99c1c3682f016ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=88081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:24:04.995394 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.fernet_utils [None req-07ee73b2-77cb-4880-b5f8-47ee0e9bbaf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:24:05.107997 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 409/823] 10.222.0.18 () {58 vars in 1024 bytes} [Sat Sep 24 19:24:04 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 19:24:05.466922 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1027615f-3980-475a-9735-baaf92f80dfd None None] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:24:05.597339 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1027615f-3980-475a-9735-baaf92f80dfd None None] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:24:05.652320 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1508030-e6eb-455b-a40a-2ff2a1a1624a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:24:05.652962 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1508030-e6eb-455b-a40a-2ff2a1a1624a None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:24:05.653236 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1508030-e6eb-455b-a40a-2ff2a1a1624a None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:24:05.653510 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1508030-e6eb-455b-a40a-2ff2a1a1624a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:24:05.664751 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1508030-e6eb-455b-a40a-2ff2a1a1624a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:24:05.666239 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1508030-e6eb-455b-a40a-2ff2a1a1624a None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:24:05.683182 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application [None req-e1508030-e6eb-455b-a40a-2ff2a1a1624a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:24:05.683182 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:24:05.683182 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:24:05.683182 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:24:05.683182 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:24:05.683182 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:24:05.683182 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:24:05.683182 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:24:05.683182 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:24:05.683182 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:24:05.683182 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:24:05.683182 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:24:05.683182 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:24:05.683182 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:24:05.683182 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:24:05.683182 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:24:05.684371 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:24:05.684371 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:24:05.684371 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:24:05.684371 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:24:05.684371 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:24:05.684371 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:24:05.684371 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:24:05.684371 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application with Lock( Sep 24 19:24:05.684371 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:24:05.684371 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:24:05.684371 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:24:05.684371 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:24:05.684371 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:24:05.684371 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:24:05.684371 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:24:05.684371 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:24:05.684371 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:24:05.685367 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:24:05.685367 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:24:05.685367 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Sep 24 19:24:05.685367 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 415/824] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Sep 24 19:24:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:24:05.691999 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ee73b2-77cb-4880-b5f8-47ee0e9bbaf3 None None] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:24:05.839195 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ee73b2-77cb-4880-b5f8-47ee0e9bbaf3 None None] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:24:05.879790 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:24:05.893022 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427180f0-671e-4f54-ace5-d30638c4382c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:24:05.893672 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427180f0-671e-4f54-ace5-d30638c4382c None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:24:05.894030 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427180f0-671e-4f54-ace5-d30638c4382c None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:24:05.894310 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427180f0-671e-4f54-ace5-d30638c4382c None admin] PATH_INFO: `/v3/domains` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:24:05.894982 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427180f0-671e-4f54-ace5-d30638c4382c None admin] RBAC: Adding query filter params (name=Default) {{(pid=88081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:24:05.895290 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427180f0-671e-4f54-ace5-d30638c4382c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:24:05.896815 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427180f0-671e-4f54-ace5-d30638c4382c None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:24:05.914122 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 410/825] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Sep 24 19:24:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:24:05.922646 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1508030-e6eb-455b-a40a-2ff2a1a1624a None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:24:06.007185 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:24:06.071261 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1508030-e6eb-455b-a40a-2ff2a1a1624a None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:24:06.113592 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc66be4d-20e3-49fc-8c16-aca249389b4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:24:06.114249 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc66be4d-20e3-49fc-8c16-aca249389b4f None admin] REQUEST_METHOD: `POST` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:24:06.114578 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc66be4d-20e3-49fc-8c16-aca249389b4f None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:24:06.114899 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc66be4d-20e3-49fc-8c16-aca249389b4f None admin] PATH_INFO: `/v3/users` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:24:06.115623 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc66be4d-20e3-49fc-8c16-aca249389b4f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:24:06.117136 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc66be4d-20e3-49fc-8c16-aca249389b4f None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:24:06.147226 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 416/826] 10.222.0.18 () {60 vars in 1132 bytes} [Sat Sep 24 19:24:05 2022] POST /identity/v3/users => generated 251 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 24 19:24:08.920304 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b7bd85-2dc8-4400-a952-e90be0b6668d None None] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:24:08.920905 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b7bd85-2dc8-4400-a952-e90be0b6668d None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:24:08.920905 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b7bd85-2dc8-4400-a952-e90be0b6668d None None] PATH_INFO: `/` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:24:08.922571 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 411/827] 10.222.0.18 () {54 vars in 927 bytes} [Sat Sep 24 19:24:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:24:08.929099 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2266faa-7019-46e3-8569-b99bec3e78e7 None None] REQUEST_METHOD: `POST` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:24:08.929619 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2266faa-7019-46e3-8569-b99bec3e78e7 None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:24:08.929619 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2266faa-7019-46e3-8569-b99bec3e78e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:24:08.951238 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.auth.core [None req-e2266faa-7019-46e3-8569-b99bec3e78e7 None None] MFA Rules not processed for user `3dbbb9909cec43ff99c1c3682f016ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=88080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:24:08.952789 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.fernet_utils [None req-e2266faa-7019-46e3-8569-b99bec3e78e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:24:09.036121 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 417/828] 10.222.0.18 () {58 vars in 1024 bytes} [Sat Sep 24 19:24:08 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 19:24:09.401350 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b7bd85-2dc8-4400-a952-e90be0b6668d None None] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:24:09.520471 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b7bd85-2dc8-4400-a952-e90be0b6668d None None] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:24:09.567620 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a5b17f-e994-4343-8a9a-a948ad5c99ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:24:09.568261 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a5b17f-e994-4343-8a9a-a948ad5c99ba None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:24:09.568539 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a5b17f-e994-4343-8a9a-a948ad5c99ba None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:24:09.568807 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a5b17f-e994-4343-8a9a-a948ad5c99ba None admin] PATH_INFO: `/v3/roles/service` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:24:09.580517 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a5b17f-e994-4343-8a9a-a948ad5c99ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:24:09.585307 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application [None req-07a5b17f-e994-4343-8a9a-a948ad5c99ba None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 24 19:24:09.585307 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:24:09.585307 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:24:09.585307 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:24:09.585307 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:24:09.585307 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:24:09.585307 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:24:09.585307 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:24:09.585307 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:24:09.585307 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:24:09.585307 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:24:09.585307 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:24:09.585307 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:24:09.585307 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:24:09.585307 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:24:09.585307 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:24:09.586850 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:24:09.586850 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:24:09.586850 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:24:09.586850 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:24:09.586850 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:24:09.586850 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:24:09.586850 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:24:09.586850 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:24:09.586850 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:24:09.586850 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:24:09.586850 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:24:09.586850 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application with Lock( Sep 24 19:24:09.586850 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:24:09.586850 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:24:09.586850 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:24:09.586850 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:24:09.588074 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:24:09.588074 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:24:09.588074 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:24:09.588074 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:24:09.588074 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:24:09.588074 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:24:09.588074 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:24:09.588074 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:24:09.588074 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:24:09.588074 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:24:09.588074 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 24 19:24:09.588074 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Sep 24 19:24:09.588074 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 412/829] 10.222.0.18 () {56 vars in 1102 bytes} [Sat Sep 24 19:24:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:24:09.593191 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2266faa-7019-46e3-8569-b99bec3e78e7 None None] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:24:09.646875 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:24:09.729446 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2266faa-7019-46e3-8569-b99bec3e78e7 None None] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:24:09.773086 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaeaa23-beaf-4b48-8469-61f77c4eb123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:24:09.773086 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaeaa23-beaf-4b48-8469-61f77c4eb123 None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:24:09.773086 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaeaa23-beaf-4b48-8469-61f77c4eb123 None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:24:09.773086 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaeaa23-beaf-4b48-8469-61f77c4eb123 None admin] PATH_INFO: `/v3/roles` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:24:09.773509 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbaeaa23-beaf-4b48-8469-61f77c4eb123 None admin] RBAC: Adding query filter params (name=service) {{(pid=88080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:24:09.773759 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbaeaa23-beaf-4b48-8469-61f77c4eb123 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:24:09.775041 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbaeaa23-beaf-4b48-8469-61f77c4eb123 None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:24:09.784371 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 418/830] 10.222.0.18 () {56 vars in 1103 bytes} [Sat Sep 24 19:24:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:24:09.790292 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a5b17f-e994-4343-8a9a-a948ad5c99ba None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:24:09.839143 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:24:09.903340 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a5b17f-e994-4343-8a9a-a948ad5c99ba None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:24:09.941308 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbdd1e4-2e90-4b3c-9864-71d89c2c7740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:24:09.942213 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbdd1e4-2e90-4b3c-9864-71d89c2c7740 None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:24:09.942354 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbdd1e4-2e90-4b3c-9864-71d89c2c7740 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:24:09.942508 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbdd1e4-2e90-4b3c-9864-71d89c2c7740 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:24:09.954623 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbdd1e4-2e90-4b3c-9864-71d89c2c7740 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:24:09.956218 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbdd1e4-2e90-4b3c-9864-71d89c2c7740 None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:24:09.972355 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application [None req-9fbdd1e4-2e90-4b3c-9864-71d89c2c7740 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:24:09.972355 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:24:09.972355 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:24:09.972355 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:24:09.972355 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:24:09.972355 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:24:09.972355 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:24:09.972355 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:24:09.972355 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:24:09.972355 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:24:09.972355 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:24:09.972355 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:24:09.972355 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:24:09.972355 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:24:09.972355 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:24:09.972355 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:24:09.973379 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:24:09.973379 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:24:09.973379 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:24:09.973379 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:24:09.973379 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:24:09.973379 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:24:09.973379 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:24:09.973379 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application with Lock( Sep 24 19:24:09.973379 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:24:09.973379 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:24:09.973379 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:24:09.973379 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:24:09.973379 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:24:09.973379 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:24:09.973379 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:24:09.973379 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:24:09.973379 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:24:09.975435 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:24:09.975435 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:24:09.975435 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Sep 24 19:24:09.975435 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 413/831] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Sep 24 19:24:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 19:24:09.980842 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaeaa23-beaf-4b48-8469-61f77c4eb123 None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:24:10.109810 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:24:10.113310 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaeaa23-beaf-4b48-8469-61f77c4eb123 None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:24:10.156394 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb3e8a7-f50e-49dd-9828-038c9920ca05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:24:10.157398 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb3e8a7-f50e-49dd-9828-038c9920ca05 None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:24:10.157943 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb3e8a7-f50e-49dd-9828-038c9920ca05 None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:24:10.158875 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb3e8a7-f50e-49dd-9828-038c9920ca05 None admin] PATH_INFO: `/v3/domains` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:24:10.159836 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb3e8a7-f50e-49dd-9828-038c9920ca05 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:24:10.160315 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb3e8a7-f50e-49dd-9828-038c9920ca05 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:24:10.161730 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb3e8a7-f50e-49dd-9828-038c9920ca05 None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:24:10.176263 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 419/832] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Sep 24 19:24:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:24:10.183145 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbdd1e4-2e90-4b3c-9864-71d89c2c7740 None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:24:10.321247 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:24:10.326411 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbdd1e4-2e90-4b3c-9864-71d89c2c7740 None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:24:10.366908 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2334011-4d6b-4946-965a-952332968da6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:24:10.367581 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2334011-4d6b-4946-965a-952332968da6 None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:24:10.367860 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2334011-4d6b-4946-965a-952332968da6 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:24:10.368133 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2334011-4d6b-4946-965a-952332968da6 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:24:10.378771 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2334011-4d6b-4946-965a-952332968da6 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:24:10.380118 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2334011-4d6b-4946-965a-952332968da6 None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:24:10.393317 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application [None req-d2334011-4d6b-4946-965a-952332968da6 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 24 19:24:10.393317 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:24:10.393317 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:24:10.393317 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:24:10.393317 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:24:10.393317 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:24:10.393317 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:24:10.393317 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:24:10.393317 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:24:10.393317 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:24:10.393317 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:24:10.393317 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:24:10.393317 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 24 19:24:10.393317 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 24 19:24:10.393317 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 24 19:24:10.393317 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 24 19:24:10.394543 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:24:10.394543 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:24:10.394543 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 24 19:24:10.394543 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 19:24:10.394543 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 24 19:24:10.394543 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 19:24:10.394543 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:24:10.394543 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:24:10.394543 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:24:10.394543 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:24:10.394543 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:24:10.394543 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application with Lock( Sep 24 19:24:10.394543 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:24:10.394543 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:24:10.394543 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:24:10.394543 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:24:10.394543 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:24:10.394543 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:24:10.398068 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:24:10.398068 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:24:10.398068 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 24 19:24:10.398068 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 24 19:24:10.398068 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 24 19:24:10.398068 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 24 19:24:10.398068 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 24 19:24:10.398068 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 24 19:24:10.398068 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 24 19:24:10.398068 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Sep 24 19:24:10.398068 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 414/833] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Sep 24 19:24:10 2022] GET /identity/v3/users/placement => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:24:10.400449 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb3e8a7-f50e-49dd-9828-038c9920ca05 None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:24:10.520771 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb3e8a7-f50e-49dd-9828-038c9920ca05 None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:24:10.572305 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2766dbae-57bb-4493-b9fd-6d620bb28192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:24:10.572900 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2766dbae-57bb-4493-b9fd-6d620bb28192 None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:24:10.573179 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2766dbae-57bb-4493-b9fd-6d620bb28192 None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:24:10.573522 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2766dbae-57bb-4493-b9fd-6d620bb28192 None admin] PATH_INFO: `/v3/users` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:24:10.574423 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2766dbae-57bb-4493-b9fd-6d620bb28192 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:24:10.574776 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2766dbae-57bb-4493-b9fd-6d620bb28192 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:24:10.576384 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2766dbae-57bb-4493-b9fd-6d620bb28192 None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:24:10.598678 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 420/834] 10.222.0.18 () {56 vars in 1143 bytes} [Sat Sep 24 19:24:10 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:24:10.604488 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2334011-4d6b-4946-965a-952332968da6 None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:24:10.732850 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2334011-4d6b-4946-965a-952332968da6 None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:24:10.778857 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0924448-5270-4239-99c1-6bc4f74e7277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:24:10.779492 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0924448-5270-4239-99c1-6bc4f74e7277 None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:24:10.779793 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0924448-5270-4239-99c1-6bc4f74e7277 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:24:10.780060 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0924448-5270-4239-99c1-6bc4f74e7277 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:24:10.822827 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:24:10.874600 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0924448-5270-4239-99c1-6bc4f74e7277 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:24:10.876503 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0924448-5270-4239-99c1-6bc4f74e7277 None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:24:11.009612 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 415/835] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Sep 24 19:24:10 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 24 19:24:11.015810 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2766dbae-57bb-4493-b9fd-6d620bb28192 None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:24:11.039316 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:24:11.132880 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2766dbae-57bb-4493-b9fd-6d620bb28192 None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:24:11.171127 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ed7626-fcf5-4376-9aef-c1fee839201e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:24:11.171748 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ed7626-fcf5-4376-9aef-c1fee839201e None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:24:11.172022 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ed7626-fcf5-4376-9aef-c1fee839201e None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:24:11.172297 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ed7626-fcf5-4376-9aef-c1fee839201e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:24:11.183152 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ed7626-fcf5-4376-9aef-c1fee839201e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:24:11.184821 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ed7626-fcf5-4376-9aef-c1fee839201e None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:24:11.202024 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application [None req-32ed7626-fcf5-4376-9aef-c1fee839201e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:24:11.202024 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:24:11.202024 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:24:11.202024 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:24:11.202024 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:24:11.202024 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:24:11.202024 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:24:11.202024 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:24:11.202024 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:24:11.202024 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:24:11.202024 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:24:11.202024 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:24:11.202024 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:24:11.202024 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:24:11.202024 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:24:11.202024 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:24:11.204492 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:24:11.204492 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:24:11.204492 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:24:11.204492 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:24:11.204492 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:24:11.204492 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:24:11.204492 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:24:11.204492 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application with Lock( Sep 24 19:24:11.204492 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:24:11.204492 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:24:11.204492 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:24:11.204492 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:24:11.204492 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:24:11.204492 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:24:11.204492 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:24:11.204492 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:24:11.204492 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:24:11.207031 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:24:11.207031 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:24:11.207031 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Sep 24 19:24:11.207031 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 421/836] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Sep 24 19:24:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:24:11.209655 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0924448-5270-4239-99c1-6bc4f74e7277 None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:24:11.276092 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:24:11.326959 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0924448-5270-4239-99c1-6bc4f74e7277 None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:24:11.366407 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278f943c-4f19-4e8d-b637-5b53ba317ff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:24:11.367018 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278f943c-4f19-4e8d-b637-5b53ba317ff0 None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:24:11.367296 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278f943c-4f19-4e8d-b637-5b53ba317ff0 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:24:11.367560 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278f943c-4f19-4e8d-b637-5b53ba317ff0 None admin] PATH_INFO: `/v3/domains` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:24:11.368198 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278f943c-4f19-4e8d-b637-5b53ba317ff0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:24:11.368496 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278f943c-4f19-4e8d-b637-5b53ba317ff0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:24:11.369868 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278f943c-4f19-4e8d-b637-5b53ba317ff0 None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:24:11.382459 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 416/837] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Sep 24 19:24:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:24:11.388367 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ed7626-fcf5-4376-9aef-c1fee839201e None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:24:11.485625 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:24:11.527388 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ed7626-fcf5-4376-9aef-c1fee839201e None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:24:11.583219 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f2c85a-5081-4bbe-88ed-be5cbc478a2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:24:11.584092 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f2c85a-5081-4bbe-88ed-be5cbc478a2d None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:24:11.584407 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f2c85a-5081-4bbe-88ed-be5cbc478a2d None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:24:11.584712 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f2c85a-5081-4bbe-88ed-be5cbc478a2d None admin] PATH_INFO: `/v3/projects/service` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:24:11.592627 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f2c85a-5081-4bbe-88ed-be5cbc478a2d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:24:11.594107 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f2c85a-5081-4bbe-88ed-be5cbc478a2d None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:24:11.610502 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application [None req-31f2c85a-5081-4bbe-88ed-be5cbc478a2d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 19:24:11.610502 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:24:11.610502 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:24:11.610502 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:24:11.610502 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:24:11.610502 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:24:11.610502 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:24:11.610502 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:24:11.610502 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:24:11.610502 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:24:11.610502 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:24:11.610502 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:24:11.610502 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 24 19:24:11.610502 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 24 19:24:11.610502 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 24 19:24:11.611657 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 24 19:24:11.611657 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:24:11.611657 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:24:11.611657 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:24:11.611657 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:24:11.611657 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:24:11.611657 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:24:11.611657 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:24:11.611657 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application with Lock( Sep 24 19:24:11.611657 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:24:11.611657 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:24:11.611657 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:24:11.611657 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:24:11.611657 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:24:11.611657 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:24:11.611657 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:24:11.611657 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:24:11.612659 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 24 19:24:11.612659 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 24 19:24:11.612659 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 24 19:24:11.612659 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 24 19:24:11.612659 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 24 19:24:11.612659 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 24 19:24:11.612659 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 19:24:11.612659 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Sep 24 19:24:11.613177 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 422/838] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Sep 24 19:24:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 19:24:11.622041 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278f943c-4f19-4e8d-b637-5b53ba317ff0 None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:24:11.780588 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278f943c-4f19-4e8d-b637-5b53ba317ff0 None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:24:11.807982 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:24:11.828478 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10ef9d8-211d-453a-80ab-5d12aaddf507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:24:11.829098 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10ef9d8-211d-453a-80ab-5d12aaddf507 None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:24:11.829362 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10ef9d8-211d-453a-80ab-5d12aaddf507 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:24:11.829627 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10ef9d8-211d-453a-80ab-5d12aaddf507 None admin] PATH_INFO: `/v3/projects` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:24:11.830412 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10ef9d8-211d-453a-80ab-5d12aaddf507 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:24:11.830716 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10ef9d8-211d-453a-80ab-5d12aaddf507 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:24:11.832174 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10ef9d8-211d-453a-80ab-5d12aaddf507 None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:24:11.846049 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 417/839] 10.222.0.18 () {56 vars in 1148 bytes} [Sat Sep 24 19:24:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:24:11.853589 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f2c85a-5081-4bbe-88ed-be5cbc478a2d None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:24:11.995405 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f2c85a-5081-4bbe-88ed-be5cbc478a2d None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:24:12.029791 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:24:12.036556 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b57bfb-c36d-493f-a04e-40bc43f792d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:24:12.037178 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b57bfb-c36d-493f-a04e-40bc43f792d4 None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:24:12.037461 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b57bfb-c36d-493f-a04e-40bc43f792d4 None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:24:12.037731 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b57bfb-c36d-493f-a04e-40bc43f792d4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:24:12.038515 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b57bfb-c36d-493f-a04e-40bc43f792d4 None admin] RBAC: Adding query filter params (role.id=0b2e96b9c7cc4c83babfba292ed46c61, scope.project.id=9dfa5c2c17244006bdd629ec81553f1a, user.id=f2dfc6ff4e9b4d30b28d39d678b19896) {{(pid=88080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:24:12.038827 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b57bfb-c36d-493f-a04e-40bc43f792d4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:24:12.040360 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b57bfb-c36d-493f-a04e-40bc43f792d4 None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:24:12.047012 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 423/840] 10.222.0.18 () {56 vars in 1374 bytes} [Sat Sep 24 19:24:11 2022] GET /identity/v3/role_assignments?user.id=f2dfc6ff4e9b4d30b28d39d678b19896&scope.project.id=9dfa5c2c17244006bdd629ec81553f1a&role.id=0b2e96b9c7cc4c83babfba292ed46c61 => generated 259 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:24:14.618278 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51fbbfb-5a38-4292-9863-368a30639acf None None] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:24:14.618946 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51fbbfb-5a38-4292-9863-368a30639acf None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:24:14.618946 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51fbbfb-5a38-4292-9863-368a30639acf None None] PATH_INFO: `/` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:24:14.620471 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 418/841] 10.222.0.18 () {54 vars in 927 bytes} [Sat Sep 24 19:24:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:24:14.626325 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecddec3-c5df-445c-b40c-b63b8c2e4e77 None None] REQUEST_METHOD: `POST` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:24:14.626840 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecddec3-c5df-445c-b40c-b63b8c2e4e77 None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:24:14.626931 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecddec3-c5df-445c-b40c-b63b8c2e4e77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:24:14.646927 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.auth.core [None req-1ecddec3-c5df-445c-b40c-b63b8c2e4e77 None None] MFA Rules not processed for user `3dbbb9909cec43ff99c1c3682f016ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=88080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:24:14.648308 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.fernet_utils [None req-1ecddec3-c5df-445c-b40c-b63b8c2e4e77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:24:14.724721 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 424/842] 10.222.0.18 () {58 vars in 1024 bytes} [Sat Sep 24 19:24:14 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 19:24:15.062080 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51fbbfb-5a38-4292-9863-368a30639acf None None] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:24:15.177210 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51fbbfb-5a38-4292-9863-368a30639acf None None] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:24:15.218707 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a5d10d-4f5e-4918-a1e9-d0eb56ea4e24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:24:15.219370 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a5d10d-4f5e-4918-a1e9-d0eb56ea4e24 None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:24:15.219642 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a5d10d-4f5e-4918-a1e9-d0eb56ea4e24 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:24:15.219906 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a5d10d-4f5e-4918-a1e9-d0eb56ea4e24 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:24:15.233345 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a5d10d-4f5e-4918-a1e9-d0eb56ea4e24 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:24:15.240312 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application [None req-39a5d10d-4f5e-4918-a1e9-d0eb56ea4e24 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 24 19:24:15.240312 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:24:15.240312 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:24:15.240312 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:24:15.240312 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:24:15.240312 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:24:15.240312 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:24:15.240312 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:24:15.240312 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:24:15.240312 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:24:15.240312 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:24:15.240312 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:24:15.240312 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:24:15.240312 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:24:15.240312 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:24:15.240312 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:24:15.241480 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:24:15.241480 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:24:15.241480 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:24:15.241480 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:24:15.241480 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:24:15.241480 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:24:15.241480 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:24:15.241480 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:24:15.241480 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:24:15.241480 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:24:15.241480 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:24:15.241480 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application with Lock( Sep 24 19:24:15.241480 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:24:15.241480 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:24:15.241480 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:24:15.241480 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:24:15.242514 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:24:15.242514 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:24:15.242514 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:24:15.242514 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:24:15.242514 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:24:15.242514 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:24:15.242514 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:24:15.242514 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:24:15.242514 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:24:15.242514 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:24:15.242514 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 24 19:24:15.242514 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Sep 24 19:24:15.242514 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 419/843] 10.222.0.18 () {56 vars in 1102 bytes} [Sat Sep 24 19:24:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:24:15.248042 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecddec3-c5df-445c-b40c-b63b8c2e4e77 None None] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:24:15.385970 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecddec3-c5df-445c-b40c-b63b8c2e4e77 None None] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:24:15.418822 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:24:15.429605 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca0102f-7d57-46ff-8692-d1e644fed9d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:24:15.430274 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca0102f-7d57-46ff-8692-d1e644fed9d4 None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:24:15.430572 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca0102f-7d57-46ff-8692-d1e644fed9d4 None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:24:15.430838 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca0102f-7d57-46ff-8692-d1e644fed9d4 None admin] PATH_INFO: `/v3/roles` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:24:15.431502 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca0102f-7d57-46ff-8692-d1e644fed9d4 None admin] RBAC: Adding query filter params (name=service) {{(pid=88080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:24:15.431799 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca0102f-7d57-46ff-8692-d1e644fed9d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:24:15.433286 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca0102f-7d57-46ff-8692-d1e644fed9d4 None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:24:15.443143 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 425/844] 10.222.0.18 () {56 vars in 1103 bytes} [Sat Sep 24 19:24:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:24:15.452668 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a5d10d-4f5e-4918-a1e9-d0eb56ea4e24 None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:24:15.497447 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:24:15.573211 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a5d10d-4f5e-4918-a1e9-d0eb56ea4e24 None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:24:15.616482 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be62a25-fa82-4da3-a470-bda658596e48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:24:15.617193 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be62a25-fa82-4da3-a470-bda658596e48 None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:24:15.617474 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be62a25-fa82-4da3-a470-bda658596e48 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:24:15.617741 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be62a25-fa82-4da3-a470-bda658596e48 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:24:15.629120 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be62a25-fa82-4da3-a470-bda658596e48 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:24:15.630547 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be62a25-fa82-4da3-a470-bda658596e48 None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:24:15.646445 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application [None req-7be62a25-fa82-4da3-a470-bda658596e48 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:24:15.646445 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:24:15.646445 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:24:15.646445 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:24:15.646445 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:24:15.646445 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:24:15.646445 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:24:15.646445 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:24:15.646445 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:24:15.646445 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:24:15.646445 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:24:15.646445 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:24:15.646445 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:24:15.646445 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:24:15.646445 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:24:15.646445 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:24:15.647466 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:24:15.647466 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:24:15.647466 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:24:15.647466 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:24:15.647466 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:24:15.647466 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:24:15.647466 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:24:15.647466 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application with Lock( Sep 24 19:24:15.647466 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:24:15.647466 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:24:15.647466 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:24:15.647466 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:24:15.647466 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:24:15.647466 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:24:15.647466 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:24:15.647466 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:24:15.647466 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:24:15.648378 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:24:15.648378 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:24:15.648378 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Sep 24 19:24:15.648378 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 420/845] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Sep 24 19:24:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:24:15.654715 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca0102f-7d57-46ff-8692-d1e644fed9d4 None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:24:15.770422 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca0102f-7d57-46ff-8692-d1e644fed9d4 None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:24:15.807011 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb6e2d6-3c46-45d6-9b16-b6975a9e272d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:24:15.807636 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb6e2d6-3c46-45d6-9b16-b6975a9e272d None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:24:15.807916 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb6e2d6-3c46-45d6-9b16-b6975a9e272d None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:24:15.808185 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb6e2d6-3c46-45d6-9b16-b6975a9e272d None admin] PATH_INFO: `/v3/domains` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:24:15.808920 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb6e2d6-3c46-45d6-9b16-b6975a9e272d None admin] RBAC: Adding query filter params (name=Default) {{(pid=88080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:24:15.809293 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb6e2d6-3c46-45d6-9b16-b6975a9e272d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:24:15.810826 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb6e2d6-3c46-45d6-9b16-b6975a9e272d None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:24:15.824036 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 426/846] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Sep 24 19:24:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:24:15.829898 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be62a25-fa82-4da3-a470-bda658596e48 None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:24:15.932253 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:24:15.945129 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be62a25-fa82-4da3-a470-bda658596e48 None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:24:15.986018 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec16eeeb-8f92-4a4a-ab45-38c651705284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:24:15.986955 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec16eeeb-8f92-4a4a-ab45-38c651705284 None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:24:15.987059 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec16eeeb-8f92-4a4a-ab45-38c651705284 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:24:15.987333 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec16eeeb-8f92-4a4a-ab45-38c651705284 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:24:15.996576 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec16eeeb-8f92-4a4a-ab45-38c651705284 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:24:15.998050 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec16eeeb-8f92-4a4a-ab45-38c651705284 None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:24:16.009681 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application [None req-ec16eeeb-8f92-4a4a-ab45-38c651705284 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 24 19:24:16.009681 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:24:16.009681 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:24:16.009681 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:24:16.009681 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:24:16.009681 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:24:16.009681 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:24:16.009681 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:24:16.009681 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:24:16.009681 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:24:16.009681 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:24:16.009681 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:24:16.009681 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 24 19:24:16.009681 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 24 19:24:16.009681 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 24 19:24:16.009681 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 24 19:24:16.010647 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:24:16.010647 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:24:16.010647 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 24 19:24:16.010647 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 19:24:16.010647 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 24 19:24:16.010647 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 19:24:16.010647 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:24:16.010647 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:24:16.010647 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:24:16.010647 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:24:16.010647 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:24:16.010647 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application with Lock( Sep 24 19:24:16.010647 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:24:16.010647 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:24:16.010647 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:24:16.010647 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:24:16.010647 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:24:16.010647 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:24:16.011577 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:24:16.011577 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:24:16.011577 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 24 19:24:16.011577 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 24 19:24:16.011577 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 24 19:24:16.011577 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 24 19:24:16.011577 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 24 19:24:16.011577 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 24 19:24:16.011577 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 24 19:24:16.011577 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Sep 24 19:24:16.011577 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 421/847] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Sep 24 19:24:15 2022] GET /identity/v3/users/placement => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 19:24:16.018791 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb6e2d6-3c46-45d6-9b16-b6975a9e272d None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:24:16.080569 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:24:16.137314 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb6e2d6-3c46-45d6-9b16-b6975a9e272d None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:24:16.175932 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4840e6-2678-4037-8153-8110c641d128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:24:16.176583 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4840e6-2678-4037-8153-8110c641d128 None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:24:16.176854 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4840e6-2678-4037-8153-8110c641d128 None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:24:16.177124 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4840e6-2678-4037-8153-8110c641d128 None admin] PATH_INFO: `/v3/users` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:24:16.177874 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4840e6-2678-4037-8153-8110c641d128 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:24:16.178178 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4840e6-2678-4037-8153-8110c641d128 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:24:16.179670 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4840e6-2678-4037-8153-8110c641d128 None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:24:16.199805 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 427/848] 10.222.0.18 () {56 vars in 1143 bytes} [Sat Sep 24 19:24:16 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:24:16.206386 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec16eeeb-8f92-4a4a-ab45-38c651705284 None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:24:16.319110 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec16eeeb-8f92-4a4a-ab45-38c651705284 None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:24:16.359690 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b549c1-46b0-409d-8872-275408f83476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:24:16.360404 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b549c1-46b0-409d-8872-275408f83476 None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:24:16.360913 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b549c1-46b0-409d-8872-275408f83476 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:24:16.361171 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b549c1-46b0-409d-8872-275408f83476 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:24:16.374277 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b549c1-46b0-409d-8872-275408f83476 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:24:16.375814 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b549c1-46b0-409d-8872-275408f83476 None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:24:16.392690 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application [None req-01b549c1-46b0-409d-8872-275408f83476 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:24:16.392690 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:24:16.392690 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:24:16.392690 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:24:16.392690 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:24:16.392690 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:24:16.392690 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:24:16.392690 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:24:16.392690 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:24:16.392690 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:24:16.392690 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:24:16.392690 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:24:16.392690 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:24:16.392690 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:24:16.392690 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:24:16.392690 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:24:16.394045 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:24:16.394045 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:24:16.394045 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:24:16.394045 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:24:16.394045 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:24:16.394045 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:24:16.394045 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:24:16.394045 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application with Lock( Sep 24 19:24:16.394045 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:24:16.394045 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:24:16.394045 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:24:16.394045 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:24:16.394045 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:24:16.394045 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:24:16.394045 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:24:16.394045 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:24:16.394045 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:24:16.395676 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:24:16.395676 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:24:16.395676 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Sep 24 19:24:16.395676 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 422/849] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Sep 24 19:24:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:24:16.399932 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4840e6-2678-4037-8153-8110c641d128 None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:24:16.514853 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4840e6-2678-4037-8153-8110c641d128 None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:24:16.517450 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:24:16.552750 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1eada6a-cd8d-461b-9486-c2f6a58703e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:24:16.553361 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eada6a-cd8d-461b-9486-c2f6a58703e2 None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:24:16.553637 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eada6a-cd8d-461b-9486-c2f6a58703e2 None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:24:16.554015 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eada6a-cd8d-461b-9486-c2f6a58703e2 None admin] PATH_INFO: `/v3/domains` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:24:16.554593 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1eada6a-cd8d-461b-9486-c2f6a58703e2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:24:16.554895 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1eada6a-cd8d-461b-9486-c2f6a58703e2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:24:16.556271 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1eada6a-cd8d-461b-9486-c2f6a58703e2 None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:24:16.569327 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 428/850] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Sep 24 19:24:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:24:16.575055 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b549c1-46b0-409d-8872-275408f83476 None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:24:16.578035 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:24:16.682827 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b549c1-46b0-409d-8872-275408f83476 None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:24:16.717610 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f640715-6909-484d-a69c-bb5820833704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:24:16.718383 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f640715-6909-484d-a69c-bb5820833704 None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:24:16.718763 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f640715-6909-484d-a69c-bb5820833704 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:24:16.719037 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f640715-6909-484d-a69c-bb5820833704 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:24:16.726814 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f640715-6909-484d-a69c-bb5820833704 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:24:16.728563 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f640715-6909-484d-a69c-bb5820833704 None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:24:16.741513 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application [None req-1f640715-6909-484d-a69c-bb5820833704 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 19:24:16.741513 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:24:16.741513 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:24:16.741513 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:24:16.741513 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:24:16.741513 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:24:16.741513 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:24:16.741513 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:24:16.741513 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:24:16.741513 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:24:16.741513 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:24:16.741513 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:24:16.741513 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 24 19:24:16.741513 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 24 19:24:16.741513 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 24 19:24:16.742641 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 24 19:24:16.742641 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:24:16.742641 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:24:16.742641 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:24:16.742641 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:24:16.742641 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:24:16.742641 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:24:16.742641 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:24:16.742641 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application with Lock( Sep 24 19:24:16.742641 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:24:16.742641 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:24:16.742641 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:24:16.742641 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:24:16.742641 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:24:16.742641 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:24:16.742641 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:24:16.742641 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:24:16.743565 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 24 19:24:16.743565 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 24 19:24:16.743565 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 24 19:24:16.743565 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 24 19:24:16.743565 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 24 19:24:16.743565 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 24 19:24:16.743565 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 19:24:16.743565 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Sep 24 19:24:16.743565 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 423/851] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Sep 24 19:24:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 19:24:16.748644 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1eada6a-cd8d-461b-9486-c2f6a58703e2 None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:24:16.856118 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1eada6a-cd8d-461b-9486-c2f6a58703e2 None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:24:16.891755 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2b2101-1f3f-430d-98d3-350e3328c68b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:24:16.892466 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2b2101-1f3f-430d-98d3-350e3328c68b None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:24:16.892813 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2b2101-1f3f-430d-98d3-350e3328c68b None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:24:16.893148 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2b2101-1f3f-430d-98d3-350e3328c68b None admin] PATH_INFO: `/v3/projects` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:24:16.893947 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2b2101-1f3f-430d-98d3-350e3328c68b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:24:16.894311 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2b2101-1f3f-430d-98d3-350e3328c68b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:24:16.895793 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2b2101-1f3f-430d-98d3-350e3328c68b None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:24:16.908478 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 429/852] 10.222.0.18 () {56 vars in 1148 bytes} [Sat Sep 24 19:24:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:24:16.914714 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f640715-6909-484d-a69c-bb5820833704 None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:24:16.978893 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:24:17.019847 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f640715-6909-484d-a69c-bb5820833704 None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:24:17.055080 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7253e16-dae8-4256-9860-9c5546a86937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:24:17.055879 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7253e16-dae8-4256-9860-9c5546a86937 None admin] REQUEST_METHOD: `PUT` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:24:17.056248 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7253e16-dae8-4256-9860-9c5546a86937 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:24:17.056627 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7253e16-dae8-4256-9860-9c5546a86937 None admin] PATH_INFO: `/v3/projects/9dfa5c2c17244006bdd629ec81553f1a/users/f2dfc6ff4e9b4d30b28d39d678b19896/roles/0b2e96b9c7cc4c83babfba292ed46c61` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:24:17.072525 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7253e16-dae8-4256-9860-9c5546a86937 None admin] RBAC: Authorizing `identity:create_grant(project_id=9dfa5c2c17244006bdd629ec81553f1a, user_id=f2dfc6ff4e9b4d30b28d39d678b19896, role_id=0b2e96b9c7cc4c83babfba292ed46c61)` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:24:17.074091 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7253e16-dae8-4256-9860-9c5546a86937 None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:24:17.088268 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 424/853] 10.222.0.18 () {58 vars in 1439 bytes} [Sat Sep 24 19:24:16 2022] PUT /identity/v3/projects/9dfa5c2c17244006bdd629ec81553f1a/users/f2dfc6ff4e9b4d30b28d39d678b19896/roles/0b2e96b9c7cc4c83babfba292ed46c61 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:24:19.714373 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f37fcc-aa15-45b7-bd6f-40ba9942a813 None None] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:24:19.714963 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f37fcc-aa15-45b7-bd6f-40ba9942a813 None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:24:19.714963 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f37fcc-aa15-45b7-bd6f-40ba9942a813 None None] PATH_INFO: `/` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:24:19.716627 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 430/854] 10.222.0.18 () {54 vars in 927 bytes} [Sat Sep 24 19:24:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:24:19.722411 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01630788-90ee-4a48-b2ed-5fcae5b7c8ad None None] REQUEST_METHOD: `POST` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:24:19.722942 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01630788-90ee-4a48-b2ed-5fcae5b7c8ad None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:24:19.722942 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01630788-90ee-4a48-b2ed-5fcae5b7c8ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:24:19.743095 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.auth.core [None req-01630788-90ee-4a48-b2ed-5fcae5b7c8ad None None] MFA Rules not processed for user `3dbbb9909cec43ff99c1c3682f016ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=88081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:24:19.744876 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.fernet_utils [None req-01630788-90ee-4a48-b2ed-5fcae5b7c8ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:24:19.819746 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 425/855] 10.222.0.18 () {58 vars in 1024 bytes} [Sat Sep 24 19:24:19 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 19:24:20.149792 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f37fcc-aa15-45b7-bd6f-40ba9942a813 None None] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:24:20.178365 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:24:20.270278 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f37fcc-aa15-45b7-bd6f-40ba9942a813 None None] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:24:20.315166 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6e07d9-09f8-4d4a-9828-51678fb621c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:24:20.315815 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6e07d9-09f8-4d4a-9828-51678fb621c6 None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:24:20.316093 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6e07d9-09f8-4d4a-9828-51678fb621c6 None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:24:20.316358 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6e07d9-09f8-4d4a-9828-51678fb621c6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:24:20.326908 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6e07d9-09f8-4d4a-9828-51678fb621c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:24:20.332380 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application [None req-6a6e07d9-09f8-4d4a-9828-51678fb621c6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 24 19:24:20.332380 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:24:20.332380 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:24:20.332380 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:24:20.332380 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:24:20.332380 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:24:20.332380 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:24:20.332380 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:24:20.332380 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:24:20.332380 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:24:20.332380 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:24:20.332380 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:24:20.332380 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:24:20.332380 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:24:20.332380 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:24:20.332380 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:24:20.333565 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:24:20.333565 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:24:20.333565 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:24:20.333565 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:24:20.333565 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:24:20.333565 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:24:20.333565 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:24:20.333565 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:24:20.333565 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:24:20.333565 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:24:20.333565 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:24:20.333565 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application with Lock( Sep 24 19:24:20.333565 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:24:20.333565 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:24:20.333565 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:24:20.333565 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:24:20.334947 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:24:20.334947 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:24:20.334947 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:24:20.334947 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:24:20.334947 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:24:20.334947 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:24:20.334947 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:24:20.334947 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:24:20.334947 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:24:20.334947 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:24:20.334947 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 24 19:24:20.334947 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Sep 24 19:24:20.334947 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 431/856] 10.222.0.18 () {56 vars in 1102 bytes} [Sat Sep 24 19:24:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:24:20.339924 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01630788-90ee-4a48-b2ed-5fcae5b7c8ad None None] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:24:20.388619 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:24:20.454415 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01630788-90ee-4a48-b2ed-5fcae5b7c8ad None None] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:24:20.493859 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9627594-86b6-48f1-aff3-57079c5aac61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:24:20.494784 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9627594-86b6-48f1-aff3-57079c5aac61 None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:24:20.495093 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9627594-86b6-48f1-aff3-57079c5aac61 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:24:20.495388 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9627594-86b6-48f1-aff3-57079c5aac61 None admin] PATH_INFO: `/v3/roles` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:24:20.496139 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9627594-86b6-48f1-aff3-57079c5aac61 None admin] RBAC: Adding query filter params (name=service) {{(pid=88081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:24:20.496546 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9627594-86b6-48f1-aff3-57079c5aac61 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:24:20.498071 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9627594-86b6-48f1-aff3-57079c5aac61 None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:24:20.508469 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 426/857] 10.222.0.18 () {56 vars in 1103 bytes} [Sat Sep 24 19:24:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:24:20.514592 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6e07d9-09f8-4d4a-9828-51678fb621c6 None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:24:20.614547 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:24:20.635350 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6e07d9-09f8-4d4a-9828-51678fb621c6 None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:24:20.673417 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0304268d-7c8e-4c3c-b013-33c109791b30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:24:20.674112 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0304268d-7c8e-4c3c-b013-33c109791b30 None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:24:20.674400 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0304268d-7c8e-4c3c-b013-33c109791b30 None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:24:20.674640 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0304268d-7c8e-4c3c-b013-33c109791b30 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:24:20.685661 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0304268d-7c8e-4c3c-b013-33c109791b30 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:24:20.687182 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0304268d-7c8e-4c3c-b013-33c109791b30 None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:24:20.703029 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application [None req-0304268d-7c8e-4c3c-b013-33c109791b30 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:24:20.703029 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:24:20.703029 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:24:20.703029 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:24:20.703029 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:24:20.703029 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:24:20.703029 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:24:20.703029 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:24:20.703029 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:24:20.703029 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:24:20.703029 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:24:20.703029 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:24:20.703029 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:24:20.703029 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:24:20.703029 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:24:20.703029 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:24:20.704729 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:24:20.704729 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:24:20.704729 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:24:20.704729 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:24:20.704729 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:24:20.704729 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:24:20.704729 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:24:20.704729 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application with Lock( Sep 24 19:24:20.704729 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:24:20.704729 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:24:20.704729 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:24:20.704729 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:24:20.704729 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:24:20.704729 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:24:20.704729 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:24:20.704729 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:24:20.704729 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:24:20.705809 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:24:20.705809 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:24:20.705809 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Sep 24 19:24:20.705809 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 432/858] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Sep 24 19:24:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 19:24:20.710542 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9627594-86b6-48f1-aff3-57079c5aac61 None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:24:20.825112 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9627594-86b6-48f1-aff3-57079c5aac61 None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:24:20.827537 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:24:20.863251 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9de847-6050-453e-a284-4976a89693c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:24:20.863950 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9de847-6050-453e-a284-4976a89693c1 None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:24:20.864244 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9de847-6050-453e-a284-4976a89693c1 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:24:20.864538 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9de847-6050-453e-a284-4976a89693c1 None admin] PATH_INFO: `/v3/domains` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:24:20.865284 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9de847-6050-453e-a284-4976a89693c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:24:20.865593 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9de847-6050-453e-a284-4976a89693c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:24:20.867087 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9de847-6050-453e-a284-4976a89693c1 None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:24:20.881848 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 427/859] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Sep 24 19:24:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:24:20.887710 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0304268d-7c8e-4c3c-b013-33c109791b30 None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:24:21.001207 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0304268d-7c8e-4c3c-b013-33c109791b30 None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:24:21.044846 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cb6637-edc5-453c-b79a-326aeb7aefc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:24:21.045571 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cb6637-edc5-453c-b79a-326aeb7aefc0 None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:24:21.045881 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cb6637-edc5-453c-b79a-326aeb7aefc0 None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:24:21.046157 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cb6637-edc5-453c-b79a-326aeb7aefc0 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:24:21.050475 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:24:21.055366 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cb6637-edc5-453c-b79a-326aeb7aefc0 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:24:21.057018 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cb6637-edc5-453c-b79a-326aeb7aefc0 None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:24:21.068784 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application [None req-f4cb6637-edc5-453c-b79a-326aeb7aefc0 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 24 19:24:21.068784 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:24:21.068784 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:24:21.068784 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:24:21.068784 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:24:21.068784 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:24:21.068784 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:24:21.068784 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:24:21.068784 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:24:21.068784 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:24:21.068784 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:24:21.068784 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:24:21.068784 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 24 19:24:21.068784 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 24 19:24:21.068784 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 24 19:24:21.068784 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 24 19:24:21.070553 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:24:21.070553 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:24:21.070553 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 24 19:24:21.070553 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 19:24:21.070553 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 24 19:24:21.070553 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 19:24:21.070553 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:24:21.070553 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:24:21.070553 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:24:21.070553 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:24:21.070553 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:24:21.070553 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application with Lock( Sep 24 19:24:21.070553 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:24:21.070553 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:24:21.070553 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:24:21.070553 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:24:21.070553 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:24:21.070553 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:24:21.071991 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:24:21.071991 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:24:21.071991 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 24 19:24:21.071991 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 24 19:24:21.071991 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 24 19:24:21.071991 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 24 19:24:21.071991 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 24 19:24:21.071991 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 24 19:24:21.071991 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 24 19:24:21.071991 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Sep 24 19:24:21.071991 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 433/860] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Sep 24 19:24:20 2022] GET /identity/v3/users/placement => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:24:21.075927 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9de847-6050-453e-a284-4976a89693c1 None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:24:21.188213 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9de847-6050-453e-a284-4976a89693c1 None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:24:21.238260 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a19d911-6853-404c-84e4-217243ef7ae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:24:21.238973 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a19d911-6853-404c-84e4-217243ef7ae2 None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:24:21.239343 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a19d911-6853-404c-84e4-217243ef7ae2 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:24:21.239703 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a19d911-6853-404c-84e4-217243ef7ae2 None admin] PATH_INFO: `/v3/users` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:24:21.240522 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a19d911-6853-404c-84e4-217243ef7ae2 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:24:21.240846 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a19d911-6853-404c-84e4-217243ef7ae2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:24:21.242518 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a19d911-6853-404c-84e4-217243ef7ae2 None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:24:21.265362 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 428/861] 10.222.0.18 () {56 vars in 1143 bytes} [Sat Sep 24 19:24:21 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:24:21.272766 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cb6637-edc5-453c-b79a-326aeb7aefc0 None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:24:21.396194 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cb6637-edc5-453c-b79a-326aeb7aefc0 None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:24:21.443402 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19d7d3e-0f75-4514-bb54-7631c4445ca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:24:21.444061 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19d7d3e-0f75-4514-bb54-7631c4445ca5 None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:24:21.444343 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19d7d3e-0f75-4514-bb54-7631c4445ca5 None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:24:21.444652 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19d7d3e-0f75-4514-bb54-7631c4445ca5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:24:21.514702 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:24:21.522923 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19d7d3e-0f75-4514-bb54-7631c4445ca5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:24:21.524503 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19d7d3e-0f75-4514-bb54-7631c4445ca5 None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:24:21.634735 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 434/862] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Sep 24 19:24:21 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 24 19:24:21.641190 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a19d911-6853-404c-84e4-217243ef7ae2 None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:24:21.669589 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:24:21.762531 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a19d911-6853-404c-84e4-217243ef7ae2 None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:24:21.801047 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0da8a9-ee4c-4ebc-8e62-6c47f0525c7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:24:21.801705 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0da8a9-ee4c-4ebc-8e62-6c47f0525c7e None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:24:21.802031 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0da8a9-ee4c-4ebc-8e62-6c47f0525c7e None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:24:21.802337 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0da8a9-ee4c-4ebc-8e62-6c47f0525c7e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:24:21.814474 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0da8a9-ee4c-4ebc-8e62-6c47f0525c7e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:24:21.816101 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0da8a9-ee4c-4ebc-8e62-6c47f0525c7e None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:24:21.840562 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application [None req-9b0da8a9-ee4c-4ebc-8e62-6c47f0525c7e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:24:21.840562 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:24:21.840562 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:24:21.840562 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:24:21.840562 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:24:21.840562 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:24:21.840562 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:24:21.840562 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:24:21.840562 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:24:21.840562 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:24:21.840562 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:24:21.840562 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:24:21.840562 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:24:21.840562 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:24:21.840562 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:24:21.840562 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:24:21.842188 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:24:21.842188 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:24:21.842188 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:24:21.842188 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:24:21.842188 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:24:21.842188 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:24:21.842188 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:24:21.842188 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application with Lock( Sep 24 19:24:21.842188 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:24:21.842188 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:24:21.842188 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:24:21.842188 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:24:21.842188 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:24:21.842188 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:24:21.842188 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:24:21.842188 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:24:21.842188 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:24:21.843115 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:24:21.843115 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:24:21.843115 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Sep 24 19:24:21.843115 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 429/863] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Sep 24 19:24:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:24:21.849631 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19d7d3e-0f75-4514-bb54-7631c4445ca5 None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:24:21.967824 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:24:21.977016 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19d7d3e-0f75-4514-bb54-7631c4445ca5 None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:24:22.017219 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f09679e-c75c-4747-a95d-138af6d155dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:24:22.017853 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f09679e-c75c-4747-a95d-138af6d155dd None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:24:22.018560 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f09679e-c75c-4747-a95d-138af6d155dd None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:24:22.018841 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f09679e-c75c-4747-a95d-138af6d155dd None admin] PATH_INFO: `/v3/domains` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:24:22.019577 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f09679e-c75c-4747-a95d-138af6d155dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=88080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:24:22.019859 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f09679e-c75c-4747-a95d-138af6d155dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:24:22.021228 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f09679e-c75c-4747-a95d-138af6d155dd None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:24:22.035401 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 435/864] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Sep 24 19:24:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:24:22.042346 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0da8a9-ee4c-4ebc-8e62-6c47f0525c7e None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:24:22.136137 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:24:22.164032 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0da8a9-ee4c-4ebc-8e62-6c47f0525c7e None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:24:22.207008 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334e7e97-6da2-47c6-a466-8687a864ddb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:24:22.207936 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334e7e97-6da2-47c6-a466-8687a864ddb3 None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:24:22.208319 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334e7e97-6da2-47c6-a466-8687a864ddb3 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:24:22.208477 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334e7e97-6da2-47c6-a466-8687a864ddb3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:24:22.215900 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334e7e97-6da2-47c6-a466-8687a864ddb3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:24:22.217342 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334e7e97-6da2-47c6-a466-8687a864ddb3 None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:24:22.229987 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application [None req-334e7e97-6da2-47c6-a466-8687a864ddb3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 19:24:22.229987 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:24:22.229987 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:24:22.229987 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:24:22.229987 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:24:22.229987 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:24:22.229987 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:24:22.229987 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:24:22.229987 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:24:22.229987 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:24:22.229987 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:24:22.229987 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:24:22.229987 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 24 19:24:22.229987 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 24 19:24:22.229987 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 24 19:24:22.231919 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 24 19:24:22.231919 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:24:22.231919 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:24:22.231919 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:24:22.231919 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:24:22.231919 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:24:22.231919 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:24:22.231919 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:24:22.231919 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application with Lock( Sep 24 19:24:22.231919 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:24:22.231919 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:24:22.231919 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:24:22.231919 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:24:22.231919 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:24:22.231919 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:24:22.231919 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:24:22.231919 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:24:22.233145 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 24 19:24:22.233145 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 24 19:24:22.233145 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 24 19:24:22.233145 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 24 19:24:22.233145 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 24 19:24:22.233145 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 24 19:24:22.233145 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 19:24:22.233145 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Sep 24 19:24:22.233145 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 430/865] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Sep 24 19:24:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 19:24:22.238049 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f09679e-c75c-4747-a95d-138af6d155dd None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:24:22.351356 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f09679e-c75c-4747-a95d-138af6d155dd None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:24:22.387961 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f634c82-8588-4443-9347-c3b60b6d452f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:24:22.388470 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f634c82-8588-4443-9347-c3b60b6d452f None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:24:22.388742 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f634c82-8588-4443-9347-c3b60b6d452f None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:24:22.389009 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f634c82-8588-4443-9347-c3b60b6d452f None admin] PATH_INFO: `/v3/projects` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:24:22.389697 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f634c82-8588-4443-9347-c3b60b6d452f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:24:22.390034 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f634c82-8588-4443-9347-c3b60b6d452f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:24:22.392081 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f634c82-8588-4443-9347-c3b60b6d452f None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:24:22.404573 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 436/866] 10.222.0.18 () {56 vars in 1148 bytes} [Sat Sep 24 19:24:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:24:22.411199 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334e7e97-6da2-47c6-a466-8687a864ddb3 None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:24:22.530802 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334e7e97-6da2-47c6-a466-8687a864ddb3 None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:24:22.578014 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0070bfb-5538-4fce-a813-cf2bbfb03e2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:24:22.579263 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0070bfb-5538-4fce-a813-cf2bbfb03e2e None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:24:22.579575 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0070bfb-5538-4fce-a813-cf2bbfb03e2e None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:24:22.579847 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0070bfb-5538-4fce-a813-cf2bbfb03e2e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:24:22.580597 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0070bfb-5538-4fce-a813-cf2bbfb03e2e None admin] RBAC: Adding query filter params (role.id=0b2e96b9c7cc4c83babfba292ed46c61, scope.project.id=9dfa5c2c17244006bdd629ec81553f1a, user.id=f2dfc6ff4e9b4d30b28d39d678b19896) {{(pid=88081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:24:22.580933 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0070bfb-5538-4fce-a813-cf2bbfb03e2e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:24:22.582580 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0070bfb-5538-4fce-a813-cf2bbfb03e2e None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:24:22.585227 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:24:22.591223 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 431/867] 10.222.0.18 () {56 vars in 1374 bytes} [Sat Sep 24 19:24:22 2022] GET /identity/v3/role_assignments?user.id=f2dfc6ff4e9b4d30b28d39d678b19896&scope.project.id=9dfa5c2c17244006bdd629ec81553f1a&role.id=0b2e96b9c7cc4c83babfba292ed46c61 => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:24:25.337787 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0f9a84-fcf2-44dd-9127-e5218ec6f216 None None] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:24:25.338785 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0f9a84-fcf2-44dd-9127-e5218ec6f216 None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:24:25.338785 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0f9a84-fcf2-44dd-9127-e5218ec6f216 None None] PATH_INFO: `/` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:24:25.339771 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 437/868] 10.222.0.18 () {54 vars in 927 bytes} [Sat Sep 24 19:24:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:24:25.346187 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1785d5bb-48db-4247-a716-49d89fd347b2 None None] REQUEST_METHOD: `POST` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:24:25.346772 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1785d5bb-48db-4247-a716-49d89fd347b2 None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:24:25.346772 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1785d5bb-48db-4247-a716-49d89fd347b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:24:25.367343 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.auth.core [None req-1785d5bb-48db-4247-a716-49d89fd347b2 None None] MFA Rules not processed for user `3dbbb9909cec43ff99c1c3682f016ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=88081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:24:25.368578 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.fernet_utils [None req-1785d5bb-48db-4247-a716-49d89fd347b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:24:25.449156 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 432/869] 10.222.0.18 () {58 vars in 1024 bytes} [Sat Sep 24 19:24:25 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 19:24:25.772260 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0f9a84-fcf2-44dd-9127-e5218ec6f216 None None] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:24:25.798950 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:24:25.897956 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0f9a84-fcf2-44dd-9127-e5218ec6f216 None None] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:24:25.933813 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01e67e3-c773-4d1b-9992-140d628fc503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:24:25.934460 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01e67e3-c773-4d1b-9992-140d628fc503 None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:24:25.934733 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01e67e3-c773-4d1b-9992-140d628fc503 None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:24:25.934999 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01e67e3-c773-4d1b-9992-140d628fc503 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:24:25.945317 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01e67e3-c773-4d1b-9992-140d628fc503 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:24:25.950095 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application [None req-d01e67e3-c773-4d1b-9992-140d628fc503 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 19:24:25.950095 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:24:25.950095 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:24:25.950095 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:24:25.950095 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:24:25.950095 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:24:25.950095 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:24:25.950095 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:24:25.950095 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:24:25.950095 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:24:25.950095 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:24:25.950095 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:24:25.950095 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:24:25.950095 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:24:25.950095 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:24:25.950095 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:24:25.951252 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:24:25.951252 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:24:25.951252 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:24:25.951252 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:24:25.951252 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:24:25.951252 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:24:25.951252 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:24:25.951252 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:24:25.951252 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:24:25.951252 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:24:25.951252 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:24:25.951252 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application with Lock( Sep 24 19:24:25.951252 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:24:25.951252 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:24:25.951252 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:24:25.951252 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:24:25.952480 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:24:25.952480 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:24:25.952480 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:24:25.952480 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:24:25.952480 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:24:25.952480 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:24:25.952480 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:24:25.952480 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:24:25.952480 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:24:25.952480 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:24:25.952480 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 19:24:25.952480 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Sep 24 19:24:25.952480 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 438/870] 10.222.0.18 () {56 vars in 1096 bytes} [Sat Sep 24 19:24:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 19:24:25.957767 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1785d5bb-48db-4247-a716-49d89fd347b2 None None] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:24:26.075656 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1785d5bb-48db-4247-a716-49d89fd347b2 None None] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:24:26.109545 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:24:26.118093 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048dd53c-80dc-4af7-a4e3-033a961bcb52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:24:26.118703 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048dd53c-80dc-4af7-a4e3-033a961bcb52 None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:24:26.118982 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048dd53c-80dc-4af7-a4e3-033a961bcb52 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:24:26.119251 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048dd53c-80dc-4af7-a4e3-033a961bcb52 None admin] PATH_INFO: `/v3/roles` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:24:26.119909 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048dd53c-80dc-4af7-a4e3-033a961bcb52 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:24:26.120208 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048dd53c-80dc-4af7-a4e3-033a961bcb52 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:24:26.121560 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048dd53c-80dc-4af7-a4e3-033a961bcb52 None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:24:26.130773 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 433/871] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Sep 24 19:24:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:24:26.136645 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01e67e3-c773-4d1b-9992-140d628fc503 None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:24:26.215466 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:24:26.238777 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01e67e3-c773-4d1b-9992-140d628fc503 None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:24:26.282546 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce323444-67da-48d6-bb9e-0d691f87b3a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:24:26.283266 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce323444-67da-48d6-bb9e-0d691f87b3a6 None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:24:26.283547 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce323444-67da-48d6-bb9e-0d691f87b3a6 None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:24:26.283865 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce323444-67da-48d6-bb9e-0d691f87b3a6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:24:26.296359 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce323444-67da-48d6-bb9e-0d691f87b3a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:24:26.298399 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce323444-67da-48d6-bb9e-0d691f87b3a6 None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:24:26.317002 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application [None req-ce323444-67da-48d6-bb9e-0d691f87b3a6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:24:26.317002 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:24:26.317002 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:24:26.317002 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:24:26.317002 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:24:26.317002 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:24:26.317002 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:24:26.317002 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:24:26.317002 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:24:26.317002 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:24:26.317002 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:24:26.317002 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:24:26.317002 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:24:26.317002 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:24:26.317002 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:24:26.317002 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:24:26.318213 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:24:26.318213 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:24:26.318213 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:24:26.318213 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:24:26.318213 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:24:26.318213 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:24:26.318213 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:24:26.318213 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application with Lock( Sep 24 19:24:26.318213 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:24:26.318213 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:24:26.318213 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:24:26.318213 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:24:26.318213 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:24:26.318213 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:24:26.318213 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:24:26.318213 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:24:26.318213 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:24:26.319102 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:24:26.319102 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:24:26.319102 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Sep 24 19:24:26.319102 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 439/872] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Sep 24 19:24:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:24:26.324304 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048dd53c-80dc-4af7-a4e3-033a961bcb52 None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:24:26.440177 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048dd53c-80dc-4af7-a4e3-033a961bcb52 None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:24:26.476345 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb97b4ab-b51e-4269-a843-3cd7f7b64424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:24:26.476960 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb97b4ab-b51e-4269-a843-3cd7f7b64424 None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:24:26.477240 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb97b4ab-b51e-4269-a843-3cd7f7b64424 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:24:26.477510 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb97b4ab-b51e-4269-a843-3cd7f7b64424 None admin] PATH_INFO: `/v3/domains` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:24:26.478184 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb97b4ab-b51e-4269-a843-3cd7f7b64424 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:24:26.478484 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb97b4ab-b51e-4269-a843-3cd7f7b64424 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:24:26.479830 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb97b4ab-b51e-4269-a843-3cd7f7b64424 None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:24:26.492584 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 434/873] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Sep 24 19:24:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:24:26.498478 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce323444-67da-48d6-bb9e-0d691f87b3a6 None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:24:26.604053 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce323444-67da-48d6-bb9e-0d691f87b3a6 None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:24:26.633364 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:24:26.641388 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fd4798-3aa2-4c55-9bf5-172f382460f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:24:26.641995 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fd4798-3aa2-4c55-9bf5-172f382460f8 None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:24:26.642272 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fd4798-3aa2-4c55-9bf5-172f382460f8 None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:24:26.642540 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fd4798-3aa2-4c55-9bf5-172f382460f8 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:24:26.650453 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fd4798-3aa2-4c55-9bf5-172f382460f8 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:24:26.651890 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fd4798-3aa2-4c55-9bf5-172f382460f8 None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:24:26.663483 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application [None req-e8fd4798-3aa2-4c55-9bf5-172f382460f8 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 24 19:24:26.663483 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:24:26.663483 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:24:26.663483 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:24:26.663483 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:24:26.663483 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:24:26.663483 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:24:26.663483 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:24:26.663483 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:24:26.663483 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:24:26.663483 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:24:26.663483 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:24:26.663483 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 24 19:24:26.663483 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 24 19:24:26.663483 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 24 19:24:26.663483 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 24 19:24:26.664677 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:24:26.664677 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:24:26.664677 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 24 19:24:26.664677 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 19:24:26.664677 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 24 19:24:26.664677 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 19:24:26.664677 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:24:26.664677 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:24:26.664677 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:24:26.664677 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:24:26.664677 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:24:26.664677 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application with Lock( Sep 24 19:24:26.664677 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:24:26.664677 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:24:26.664677 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:24:26.664677 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:24:26.664677 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:24:26.664677 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:24:26.665873 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:24:26.665873 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:24:26.665873 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 24 19:24:26.665873 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 24 19:24:26.665873 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 24 19:24:26.665873 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 24 19:24:26.665873 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 24 19:24:26.665873 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 24 19:24:26.665873 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 24 19:24:26.665873 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Sep 24 19:24:26.665873 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 440/874] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Sep 24 19:24:26 2022] GET /identity/v3/users/placement => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:24:26.670758 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb97b4ab-b51e-4269-a843-3cd7f7b64424 None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:24:26.722357 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:24:26.775665 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb97b4ab-b51e-4269-a843-3cd7f7b64424 None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:24:26.809916 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815c7635-53d7-47fe-bf83-3696f21f0676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:24:26.810512 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815c7635-53d7-47fe-bf83-3696f21f0676 None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:24:26.810783 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815c7635-53d7-47fe-bf83-3696f21f0676 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:24:26.811050 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815c7635-53d7-47fe-bf83-3696f21f0676 None admin] PATH_INFO: `/v3/users` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:24:26.811761 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815c7635-53d7-47fe-bf83-3696f21f0676 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:24:26.812054 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815c7635-53d7-47fe-bf83-3696f21f0676 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:24:26.813474 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815c7635-53d7-47fe-bf83-3696f21f0676 None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:24:26.830157 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 435/875] 10.222.0.18 () {56 vars in 1143 bytes} [Sat Sep 24 19:24:26 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:24:26.835902 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fd4798-3aa2-4c55-9bf5-172f382460f8 None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:24:26.939577 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fd4798-3aa2-4c55-9bf5-172f382460f8 None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:24:26.972679 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58ac5b7-09af-4b80-8f28-4b3730f40912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:24:26.973189 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58ac5b7-09af-4b80-8f28-4b3730f40912 None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:24:26.973462 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58ac5b7-09af-4b80-8f28-4b3730f40912 None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:24:26.973728 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58ac5b7-09af-4b80-8f28-4b3730f40912 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:24:27.028350 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:24:27.043297 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58ac5b7-09af-4b80-8f28-4b3730f40912 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:24:27.046037 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58ac5b7-09af-4b80-8f28-4b3730f40912 None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:24:27.207006 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 441/876] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Sep 24 19:24:26 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 24 19:24:27.212839 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815c7635-53d7-47fe-bf83-3696f21f0676 None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:24:27.319964 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815c7635-53d7-47fe-bf83-3696f21f0676 None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:24:27.330052 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:24:27.355617 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34307827-0a52-4f26-ba63-3e2173ac1ba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:24:27.356245 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34307827-0a52-4f26-ba63-3e2173ac1ba8 None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:24:27.356520 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34307827-0a52-4f26-ba63-3e2173ac1ba8 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:24:27.356786 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34307827-0a52-4f26-ba63-3e2173ac1ba8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:24:27.366760 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34307827-0a52-4f26-ba63-3e2173ac1ba8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:24:27.368185 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34307827-0a52-4f26-ba63-3e2173ac1ba8 None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:24:27.382584 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application [None req-34307827-0a52-4f26-ba63-3e2173ac1ba8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:24:27.382584 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:24:27.382584 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:24:27.382584 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:24:27.382584 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:24:27.382584 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:24:27.382584 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:24:27.382584 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:24:27.382584 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:24:27.382584 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:24:27.382584 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:24:27.382584 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:24:27.382584 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:24:27.382584 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:24:27.382584 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:24:27.382584 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:24:27.384383 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:24:27.384383 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:24:27.384383 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:24:27.384383 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:24:27.384383 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:24:27.384383 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:24:27.384383 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:24:27.384383 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application with Lock( Sep 24 19:24:27.384383 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:24:27.384383 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:24:27.384383 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:24:27.384383 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:24:27.384383 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:24:27.384383 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:24:27.384383 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:24:27.384383 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:24:27.384383 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:24:27.386437 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:24:27.386437 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:24:27.386437 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Sep 24 19:24:27.386437 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 436/877] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Sep 24 19:24:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:24:27.391564 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58ac5b7-09af-4b80-8f28-4b3730f40912 None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:24:27.480843 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:24:27.493799 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58ac5b7-09af-4b80-8f28-4b3730f40912 None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:24:27.529283 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4ad4f7-b0d1-460d-8375-4f0c0849ce4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:24:27.530011 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4ad4f7-b0d1-460d-8375-4f0c0849ce4e None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:24:27.530206 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4ad4f7-b0d1-460d-8375-4f0c0849ce4e None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:24:27.530471 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4ad4f7-b0d1-460d-8375-4f0c0849ce4e None admin] PATH_INFO: `/v3/domains` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:24:27.531130 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4ad4f7-b0d1-460d-8375-4f0c0849ce4e None admin] RBAC: Adding query filter params (name=Default) {{(pid=88080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:24:27.531430 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4ad4f7-b0d1-460d-8375-4f0c0849ce4e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:24:27.532834 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4ad4f7-b0d1-460d-8375-4f0c0849ce4e None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:24:27.546621 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 442/878] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Sep 24 19:24:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:24:27.553170 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34307827-0a52-4f26-ba63-3e2173ac1ba8 None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:24:27.675247 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34307827-0a52-4f26-ba63-3e2173ac1ba8 None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:24:27.711787 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3478dcbd-28e0-4cc2-bce4-3ae1e3576674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:24:27.712414 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3478dcbd-28e0-4cc2-bce4-3ae1e3576674 None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:24:27.712685 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3478dcbd-28e0-4cc2-bce4-3ae1e3576674 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:24:27.712948 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3478dcbd-28e0-4cc2-bce4-3ae1e3576674 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:24:27.719993 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3478dcbd-28e0-4cc2-bce4-3ae1e3576674 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:24:27.721426 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3478dcbd-28e0-4cc2-bce4-3ae1e3576674 None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:24:27.733674 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application [None req-3478dcbd-28e0-4cc2-bce4-3ae1e3576674 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 19:24:27.733674 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:24:27.733674 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:24:27.733674 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:24:27.733674 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:24:27.733674 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:24:27.733674 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:24:27.733674 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:24:27.733674 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:24:27.733674 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:24:27.733674 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:24:27.733674 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:24:27.733674 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 24 19:24:27.733674 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 24 19:24:27.733674 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 24 19:24:27.734868 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 24 19:24:27.734868 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:24:27.734868 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:24:27.734868 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:24:27.734868 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:24:27.734868 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:24:27.734868 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:24:27.734868 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:24:27.734868 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application with Lock( Sep 24 19:24:27.734868 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:24:27.734868 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:24:27.734868 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:24:27.734868 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:24:27.734868 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:24:27.734868 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:24:27.734868 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:24:27.734868 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:24:27.735947 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 24 19:24:27.735947 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 24 19:24:27.735947 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 24 19:24:27.735947 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 24 19:24:27.735947 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 24 19:24:27.735947 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 24 19:24:27.735947 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 19:24:27.735947 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Sep 24 19:24:27.735947 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 437/879] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Sep 24 19:24:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:24:27.741214 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4ad4f7-b0d1-460d-8375-4f0c0849ce4e None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:24:27.845343 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4ad4f7-b0d1-460d-8375-4f0c0849ce4e None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:24:27.878862 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae9c4c4-51e1-43ce-bc91-95706aa32fef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:24:27.879460 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae9c4c4-51e1-43ce-bc91-95706aa32fef None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:24:27.879731 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae9c4c4-51e1-43ce-bc91-95706aa32fef None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:24:27.879994 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae9c4c4-51e1-43ce-bc91-95706aa32fef None admin] PATH_INFO: `/v3/projects` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:24:27.880675 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae9c4c4-51e1-43ce-bc91-95706aa32fef None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:24:27.880972 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae9c4c4-51e1-43ce-bc91-95706aa32fef None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:24:27.882408 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae9c4c4-51e1-43ce-bc91-95706aa32fef None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:24:27.895115 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 443/880] 10.222.0.18 () {56 vars in 1148 bytes} [Sat Sep 24 19:24:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:24:27.901335 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3478dcbd-28e0-4cc2-bce4-3ae1e3576674 None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:24:27.925793 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:24:28.006103 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3478dcbd-28e0-4cc2-bce4-3ae1e3576674 None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:24:28.041156 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7922cd57-37d5-4c97-8c3c-121860ea6c22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:24:28.041752 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7922cd57-37d5-4c97-8c3c-121860ea6c22 None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:24:28.042055 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7922cd57-37d5-4c97-8c3c-121860ea6c22 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:24:28.042321 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7922cd57-37d5-4c97-8c3c-121860ea6c22 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:24:28.043037 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7922cd57-37d5-4c97-8c3c-121860ea6c22 None admin] RBAC: Adding query filter params (role.id=4c7d0dafc19b4b0a9821be6ec0da0a8f, scope.project.id=9dfa5c2c17244006bdd629ec81553f1a, user.id=f2dfc6ff4e9b4d30b28d39d678b19896) {{(pid=88081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:24:28.043343 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7922cd57-37d5-4c97-8c3c-121860ea6c22 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:24:28.044790 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7922cd57-37d5-4c97-8c3c-121860ea6c22 None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:24:28.050827 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 438/881] 10.222.0.18 () {56 vars in 1374 bytes} [Sat Sep 24 19:24:27 2022] GET /identity/v3/role_assignments?user.id=f2dfc6ff4e9b4d30b28d39d678b19896&scope.project.id=9dfa5c2c17244006bdd629ec81553f1a&role.id=4c7d0dafc19b4b0a9821be6ec0da0a8f => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:24:30.498549 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55316601-4add-445f-8140-91aa3438110f None None] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:24:30.499116 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55316601-4add-445f-8140-91aa3438110f None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:24:30.499116 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55316601-4add-445f-8140-91aa3438110f None None] PATH_INFO: `/` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:24:30.500975 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 444/882] 10.222.0.18 () {54 vars in 927 bytes} [Sat Sep 24 19:24:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:24:30.507355 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd4108b-fa99-4eeb-8ec6-e603c5d12856 None None] REQUEST_METHOD: `POST` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:24:30.507960 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd4108b-fa99-4eeb-8ec6-e603c5d12856 None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:24:30.507960 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd4108b-fa99-4eeb-8ec6-e603c5d12856 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:24:30.527154 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.auth.core [None req-5cd4108b-fa99-4eeb-8ec6-e603c5d12856 None None] MFA Rules not processed for user `3dbbb9909cec43ff99c1c3682f016ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=88081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:24:30.528357 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.fernet_utils [None req-5cd4108b-fa99-4eeb-8ec6-e603c5d12856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:24:30.598972 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 439/883] 10.222.0.18 () {58 vars in 1024 bytes} [Sat Sep 24 19:24:30 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 19:24:30.916695 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55316601-4add-445f-8140-91aa3438110f None None] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:24:30.928587 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:24:31.022506 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55316601-4add-445f-8140-91aa3438110f None None] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:24:31.057006 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fea793c-216b-49bf-8119-89b66d0ffb7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:24:31.057634 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fea793c-216b-49bf-8119-89b66d0ffb7a None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:24:31.057938 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fea793c-216b-49bf-8119-89b66d0ffb7a None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:24:31.058198 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fea793c-216b-49bf-8119-89b66d0ffb7a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:24:31.069613 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fea793c-216b-49bf-8119-89b66d0ffb7a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:24:31.074479 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application [None req-7fea793c-216b-49bf-8119-89b66d0ffb7a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 19:24:31.074479 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:24:31.074479 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:24:31.074479 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:24:31.074479 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:24:31.074479 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:24:31.074479 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:24:31.074479 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:24:31.074479 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:24:31.074479 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:24:31.074479 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:24:31.074479 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:24:31.074479 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:24:31.074479 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:24:31.074479 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:24:31.074479 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:24:31.076469 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:24:31.076469 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:24:31.076469 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:24:31.076469 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:24:31.076469 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:24:31.076469 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:24:31.076469 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:24:31.076469 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:24:31.076469 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:24:31.076469 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:24:31.076469 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:24:31.076469 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application with Lock( Sep 24 19:24:31.076469 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:24:31.076469 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:24:31.076469 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:24:31.076469 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:24:31.078619 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:24:31.078619 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:24:31.078619 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:24:31.078619 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:24:31.078619 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:24:31.078619 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:24:31.078619 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:24:31.078619 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:24:31.078619 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:24:31.078619 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:24:31.078619 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 19:24:31.078619 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Sep 24 19:24:31.078619 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 445/884] 10.222.0.18 () {56 vars in 1096 bytes} [Sat Sep 24 19:24:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:24:31.082733 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd4108b-fa99-4eeb-8ec6-e603c5d12856 None None] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:24:31.098377 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:24:31.182303 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd4108b-fa99-4eeb-8ec6-e603c5d12856 None None] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:24:31.222187 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f8bedc-bd46-4ced-af5a-060c81a83418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:24:31.222812 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f8bedc-bd46-4ced-af5a-060c81a83418 None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:24:31.223089 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f8bedc-bd46-4ced-af5a-060c81a83418 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:24:31.223356 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f8bedc-bd46-4ced-af5a-060c81a83418 None admin] PATH_INFO: `/v3/roles` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:24:31.224019 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f8bedc-bd46-4ced-af5a-060c81a83418 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:24:31.224319 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f8bedc-bd46-4ced-af5a-060c81a83418 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:24:31.225713 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f8bedc-bd46-4ced-af5a-060c81a83418 None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:24:31.237050 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 440/885] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Sep 24 19:24:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:24:31.245395 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fea793c-216b-49bf-8119-89b66d0ffb7a None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:24:31.356316 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:24:31.392674 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fea793c-216b-49bf-8119-89b66d0ffb7a None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:24:31.435033 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b193a82f-3b83-4671-b912-1916d3a02639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:24:31.435665 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b193a82f-3b83-4671-b912-1916d3a02639 None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:24:31.435943 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b193a82f-3b83-4671-b912-1916d3a02639 None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:24:31.436214 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b193a82f-3b83-4671-b912-1916d3a02639 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:24:31.448044 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b193a82f-3b83-4671-b912-1916d3a02639 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:24:31.449505 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b193a82f-3b83-4671-b912-1916d3a02639 None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:24:31.465462 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application [None req-b193a82f-3b83-4671-b912-1916d3a02639 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:24:31.465462 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:24:31.465462 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:24:31.465462 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:24:31.465462 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:24:31.465462 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:24:31.465462 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:24:31.465462 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:24:31.465462 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:24:31.465462 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:24:31.465462 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:24:31.465462 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:24:31.465462 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:24:31.465462 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:24:31.465462 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:24:31.465462 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:24:31.466682 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:24:31.466682 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:24:31.466682 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:24:31.466682 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:24:31.466682 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:24:31.466682 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:24:31.466682 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:24:31.466682 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application with Lock( Sep 24 19:24:31.466682 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:24:31.466682 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:24:31.466682 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:24:31.466682 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:24:31.466682 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:24:31.466682 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:24:31.466682 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:24:31.466682 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:24:31.466682 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:24:31.467558 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:24:31.467558 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:24:31.467558 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Sep 24 19:24:31.467558 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 446/886] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Sep 24 19:24:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 19:24:31.473006 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f8bedc-bd46-4ced-af5a-060c81a83418 None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:24:31.554314 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:24:31.580369 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f8bedc-bd46-4ced-af5a-060c81a83418 None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:24:31.628526 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1465821a-e111-4c8d-8b77-b1bc42303f27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:24:31.629046 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1465821a-e111-4c8d-8b77-b1bc42303f27 None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:24:31.629321 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1465821a-e111-4c8d-8b77-b1bc42303f27 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:24:31.629585 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1465821a-e111-4c8d-8b77-b1bc42303f27 None admin] PATH_INFO: `/v3/domains` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:24:31.630249 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1465821a-e111-4c8d-8b77-b1bc42303f27 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:24:31.630547 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1465821a-e111-4c8d-8b77-b1bc42303f27 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:24:31.631896 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1465821a-e111-4c8d-8b77-b1bc42303f27 None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:24:31.644494 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 441/887] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Sep 24 19:24:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:24:31.650286 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b193a82f-3b83-4671-b912-1916d3a02639 None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:24:31.760180 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b193a82f-3b83-4671-b912-1916d3a02639 None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:24:31.782577 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:24:31.796861 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a381cb96-8aa3-4658-81c7-f21dbdb6ebe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:24:31.797483 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a381cb96-8aa3-4658-81c7-f21dbdb6ebe3 None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:24:31.797757 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a381cb96-8aa3-4658-81c7-f21dbdb6ebe3 None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:24:31.798070 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a381cb96-8aa3-4658-81c7-f21dbdb6ebe3 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:24:31.805573 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a381cb96-8aa3-4658-81c7-f21dbdb6ebe3 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:24:31.807039 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a381cb96-8aa3-4658-81c7-f21dbdb6ebe3 None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:24:31.818323 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application [None req-a381cb96-8aa3-4658-81c7-f21dbdb6ebe3 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 24 19:24:31.818323 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:24:31.818323 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:24:31.818323 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:24:31.818323 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:24:31.818323 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:24:31.818323 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:24:31.818323 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:24:31.818323 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:24:31.818323 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:24:31.818323 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:24:31.818323 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:24:31.818323 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 24 19:24:31.818323 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 24 19:24:31.818323 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 24 19:24:31.818323 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 24 19:24:31.819445 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:24:31.819445 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:24:31.819445 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 24 19:24:31.819445 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 19:24:31.819445 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 24 19:24:31.819445 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 19:24:31.819445 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:24:31.819445 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:24:31.819445 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:24:31.819445 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:24:31.819445 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:24:31.819445 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application with Lock( Sep 24 19:24:31.819445 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:24:31.819445 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:24:31.819445 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:24:31.819445 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:24:31.819445 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:24:31.819445 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:24:31.820412 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:24:31.820412 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:24:31.820412 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 24 19:24:31.820412 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 24 19:24:31.820412 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 24 19:24:31.820412 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 24 19:24:31.820412 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 24 19:24:31.820412 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 24 19:24:31.820412 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 24 19:24:31.820412 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Sep 24 19:24:31.820412 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 447/888] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Sep 24 19:24:31 2022] GET /identity/v3/users/placement => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:24:31.826669 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1465821a-e111-4c8d-8b77-b1bc42303f27 None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:24:31.931337 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1465821a-e111-4c8d-8b77-b1bc42303f27 None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:24:31.965531 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52c182f-bb92-4b88-a1ae-c05eb05fd186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:24:31.966161 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52c182f-bb92-4b88-a1ae-c05eb05fd186 None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:24:31.966439 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52c182f-bb92-4b88-a1ae-c05eb05fd186 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:24:31.966708 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52c182f-bb92-4b88-a1ae-c05eb05fd186 None admin] PATH_INFO: `/v3/users` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:24:31.967431 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52c182f-bb92-4b88-a1ae-c05eb05fd186 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:24:31.967729 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52c182f-bb92-4b88-a1ae-c05eb05fd186 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:24:31.969788 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52c182f-bb92-4b88-a1ae-c05eb05fd186 None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:24:31.972414 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:24:31.988297 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 442/889] 10.222.0.18 () {56 vars in 1143 bytes} [Sat Sep 24 19:24:31 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:24:31.994414 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a381cb96-8aa3-4658-81c7-f21dbdb6ebe3 None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:24:32.146828 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a381cb96-8aa3-4658-81c7-f21dbdb6ebe3 None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:24:32.186543 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5f403f-f9cc-4c11-9966-24e23ac421f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:24:32.187104 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5f403f-f9cc-4c11-9966-24e23ac421f5 None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:24:32.187888 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5f403f-f9cc-4c11-9966-24e23ac421f5 None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:24:32.188157 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5f403f-f9cc-4c11-9966-24e23ac421f5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:24:32.200087 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5f403f-f9cc-4c11-9966-24e23ac421f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:24:32.201868 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5f403f-f9cc-4c11-9966-24e23ac421f5 None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:24:32.218683 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application [None req-ee5f403f-f9cc-4c11-9966-24e23ac421f5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:24:32.218683 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:24:32.218683 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:24:32.218683 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:24:32.218683 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:24:32.218683 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:24:32.218683 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:24:32.218683 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:24:32.218683 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:24:32.218683 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:24:32.218683 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:24:32.218683 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:24:32.218683 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:24:32.218683 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:24:32.218683 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:24:32.218683 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:24:32.224399 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:24:32.224399 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:24:32.224399 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:24:32.224399 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:24:32.224399 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:24:32.224399 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:24:32.224399 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:24:32.224399 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application with Lock( Sep 24 19:24:32.224399 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:24:32.224399 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:24:32.224399 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:24:32.224399 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:24:32.224399 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:24:32.224399 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:24:32.224399 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:24:32.224399 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:24:32.224399 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:24:32.225604 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:24:32.225604 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:24:32.225604 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Sep 24 19:24:32.225604 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 448/890] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Sep 24 19:24:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:24:32.225955 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52c182f-bb92-4b88-a1ae-c05eb05fd186 None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:24:32.337683 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52c182f-bb92-4b88-a1ae-c05eb05fd186 None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:24:32.372746 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74547f0f-9e61-458f-a15f-3455a61dbfb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:24:32.373354 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74547f0f-9e61-458f-a15f-3455a61dbfb9 None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:24:32.373625 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74547f0f-9e61-458f-a15f-3455a61dbfb9 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:24:32.373915 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74547f0f-9e61-458f-a15f-3455a61dbfb9 None admin] PATH_INFO: `/v3/domains` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:24:32.374553 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74547f0f-9e61-458f-a15f-3455a61dbfb9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:24:32.374874 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74547f0f-9e61-458f-a15f-3455a61dbfb9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:24:32.376785 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74547f0f-9e61-458f-a15f-3455a61dbfb9 None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:24:32.388714 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 443/891] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Sep 24 19:24:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:24:32.395963 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5f403f-f9cc-4c11-9966-24e23ac421f5 None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:24:32.439632 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:24:32.511506 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5f403f-f9cc-4c11-9966-24e23ac421f5 None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:24:32.547355 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a342200-275d-48c4-a6d0-061f1c6364be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:24:32.547979 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a342200-275d-48c4-a6d0-061f1c6364be None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:24:32.548256 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a342200-275d-48c4-a6d0-061f1c6364be None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:24:32.548563 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a342200-275d-48c4-a6d0-061f1c6364be None admin] PATH_INFO: `/v3/projects/service` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:24:32.555447 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a342200-275d-48c4-a6d0-061f1c6364be None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:24:32.556897 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a342200-275d-48c4-a6d0-061f1c6364be None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:24:32.572786 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application [None req-7a342200-275d-48c4-a6d0-061f1c6364be None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 19:24:32.572786 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:24:32.572786 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:24:32.572786 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:24:32.572786 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:24:32.572786 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:24:32.572786 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:24:32.572786 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:24:32.572786 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:24:32.572786 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:24:32.572786 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:24:32.572786 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:24:32.572786 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 24 19:24:32.572786 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 24 19:24:32.572786 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 24 19:24:32.574014 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 24 19:24:32.574014 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:24:32.574014 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:24:32.574014 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:24:32.574014 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:24:32.574014 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:24:32.574014 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:24:32.574014 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:24:32.574014 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application with Lock( Sep 24 19:24:32.574014 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:24:32.574014 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:24:32.574014 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:24:32.574014 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:24:32.574014 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:24:32.574014 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:24:32.574014 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:24:32.574014 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:24:32.575200 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 24 19:24:32.575200 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 24 19:24:32.575200 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 24 19:24:32.575200 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 24 19:24:32.575200 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 24 19:24:32.575200 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 24 19:24:32.575200 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 19:24:32.575200 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Sep 24 19:24:32.575200 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 449/892] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Sep 24 19:24:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:24:32.580494 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74547f0f-9e61-458f-a15f-3455a61dbfb9 None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:24:32.639164 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:24:32.687261 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74547f0f-9e61-458f-a15f-3455a61dbfb9 None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:24:32.722779 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f39753-57d6-4ef9-ad0b-58d293ed9a57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:24:32.723307 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f39753-57d6-4ef9-ad0b-58d293ed9a57 None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:24:32.723583 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f39753-57d6-4ef9-ad0b-58d293ed9a57 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:24:32.723852 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f39753-57d6-4ef9-ad0b-58d293ed9a57 None admin] PATH_INFO: `/v3/projects` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:24:32.724540 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f39753-57d6-4ef9-ad0b-58d293ed9a57 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:24:32.724849 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f39753-57d6-4ef9-ad0b-58d293ed9a57 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:24:32.726298 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f39753-57d6-4ef9-ad0b-58d293ed9a57 None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:24:32.739676 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 444/893] 10.222.0.18 () {56 vars in 1148 bytes} [Sat Sep 24 19:24:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:24:32.745673 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a342200-275d-48c4-a6d0-061f1c6364be None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:24:32.840330 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:24:32.850425 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a342200-275d-48c4-a6d0-061f1c6364be None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:24:32.885139 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c109ef-6b88-4641-b60e-5295df516579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:24:32.885809 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c109ef-6b88-4641-b60e-5295df516579 None admin] REQUEST_METHOD: `PUT` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:24:32.886124 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c109ef-6b88-4641-b60e-5295df516579 None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:24:32.886401 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c109ef-6b88-4641-b60e-5295df516579 None admin] PATH_INFO: `/v3/projects/9dfa5c2c17244006bdd629ec81553f1a/users/f2dfc6ff4e9b4d30b28d39d678b19896/roles/4c7d0dafc19b4b0a9821be6ec0da0a8f` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:24:32.888358 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c109ef-6b88-4641-b60e-5295df516579 None admin] RBAC: Authorizing `identity:create_grant(project_id=9dfa5c2c17244006bdd629ec81553f1a, user_id=f2dfc6ff4e9b4d30b28d39d678b19896, role_id=4c7d0dafc19b4b0a9821be6ec0da0a8f)` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:24:32.889797 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c109ef-6b88-4641-b60e-5295df516579 None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:24:32.904184 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 450/894] 10.222.0.18 () {58 vars in 1439 bytes} [Sat Sep 24 19:24:32 2022] PUT /identity/v3/projects/9dfa5c2c17244006bdd629ec81553f1a/users/f2dfc6ff4e9b4d30b28d39d678b19896/roles/4c7d0dafc19b4b0a9821be6ec0da0a8f => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:24:35.331862 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99bbf70-b76f-4138-bca7-7554e9f8a3f8 None None] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:24:35.332459 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99bbf70-b76f-4138-bca7-7554e9f8a3f8 None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:24:35.332459 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99bbf70-b76f-4138-bca7-7554e9f8a3f8 None None] PATH_INFO: `/` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:24:35.333799 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 445/895] 10.222.0.18 () {54 vars in 927 bytes} [Sat Sep 24 19:24:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:24:35.339857 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ec0f84-588b-4e50-8b2e-aafa2eae92b9 None None] REQUEST_METHOD: `POST` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:24:35.340397 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ec0f84-588b-4e50-8b2e-aafa2eae92b9 None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:24:35.340397 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ec0f84-588b-4e50-8b2e-aafa2eae92b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:24:35.361562 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.auth.core [None req-46ec0f84-588b-4e50-8b2e-aafa2eae92b9 None None] MFA Rules not processed for user `3dbbb9909cec43ff99c1c3682f016ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=88080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:24:35.362805 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.fernet_utils [None req-46ec0f84-588b-4e50-8b2e-aafa2eae92b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:24:35.440346 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 451/896] 10.222.0.18 () {58 vars in 1024 bytes} [Sat Sep 24 19:24:35 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 19:24:35.762334 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99bbf70-b76f-4138-bca7-7554e9f8a3f8 None None] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:24:35.863616 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99bbf70-b76f-4138-bca7-7554e9f8a3f8 None None] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:24:35.877266 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:24:35.897421 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b37667c-c43c-449d-a812-939a06060159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:24:35.898065 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b37667c-c43c-449d-a812-939a06060159 None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:24:35.898348 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b37667c-c43c-449d-a812-939a06060159 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:24:35.898612 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b37667c-c43c-449d-a812-939a06060159 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:24:35.909156 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b37667c-c43c-449d-a812-939a06060159 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 19:24:35.914048 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application [None req-6b37667c-c43c-449d-a812-939a06060159 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 19:24:35.914048 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:24:35.914048 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:24:35.914048 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:24:35.914048 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:24:35.914048 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:24:35.914048 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:24:35.914048 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:24:35.914048 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:24:35.914048 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:24:35.914048 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:24:35.914048 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:24:35.914048 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 19:24:35.914048 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 19:24:35.914048 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 19:24:35.914048 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 19:24:35.916088 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 19:24:35.916088 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 19:24:35.916088 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 19:24:35.916088 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 19:24:35.916088 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:24:35.916088 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:24:35.916088 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:24:35.916088 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:24:35.916088 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:24:35.916088 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:24:35.916088 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:24:35.916088 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application with Lock( Sep 24 19:24:35.916088 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:24:35.916088 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:24:35.916088 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:24:35.916088 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:24:35.918163 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:24:35.918163 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:24:35.918163 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:24:35.918163 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:24:35.918163 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 19:24:35.918163 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 19:24:35.918163 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 19:24:35.918163 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 19:24:35.918163 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 19:24:35.918163 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 19:24:35.918163 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 19:24:35.918163 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Sep 24 19:24:35.918163 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 446/897] 10.222.0.18 () {56 vars in 1096 bytes} [Sat Sep 24 19:24:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:24:35.921268 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ec0f84-588b-4e50-8b2e-aafa2eae92b9 None None] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:24:36.016266 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:24:36.035621 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ec0f84-588b-4e50-8b2e-aafa2eae92b9 None None] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:24:36.069728 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775050e8-e1f2-4450-bb8e-8a5e8c26dfa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:24:36.070352 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775050e8-e1f2-4450-bb8e-8a5e8c26dfa0 None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:24:36.070629 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775050e8-e1f2-4450-bb8e-8a5e8c26dfa0 None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:24:36.070900 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775050e8-e1f2-4450-bb8e-8a5e8c26dfa0 None admin] PATH_INFO: `/v3/roles` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:24:36.071558 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775050e8-e1f2-4450-bb8e-8a5e8c26dfa0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:24:36.071859 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775050e8-e1f2-4450-bb8e-8a5e8c26dfa0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:24:36.073229 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775050e8-e1f2-4450-bb8e-8a5e8c26dfa0 None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:24:36.081820 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 452/898] 10.222.0.18 () {56 vars in 1099 bytes} [Sat Sep 24 19:24:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:24:36.087731 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b37667c-c43c-449d-a812-939a06060159 None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:24:36.194911 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b37667c-c43c-449d-a812-939a06060159 None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:24:36.236190 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e67070f-49df-4cbb-8382-acd4b9ee99d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:24:36.236821 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e67070f-49df-4cbb-8382-acd4b9ee99d8 None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:24:36.237101 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e67070f-49df-4cbb-8382-acd4b9ee99d8 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:24:36.237371 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e67070f-49df-4cbb-8382-acd4b9ee99d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:24:36.249438 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e67070f-49df-4cbb-8382-acd4b9ee99d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:24:36.251139 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e67070f-49df-4cbb-8382-acd4b9ee99d8 None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:24:36.269565 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application [None req-2e67070f-49df-4cbb-8382-acd4b9ee99d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:24:36.269565 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:24:36.269565 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:24:36.269565 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:24:36.269565 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:24:36.269565 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:24:36.269565 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:24:36.269565 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:24:36.269565 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:24:36.269565 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:24:36.269565 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:24:36.269565 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:24:36.269565 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:24:36.269565 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:24:36.269565 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:24:36.269565 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:24:36.270864 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:24:36.270864 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:24:36.270864 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:24:36.270864 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:24:36.270864 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:24:36.270864 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:24:36.270864 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:24:36.270864 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application with Lock( Sep 24 19:24:36.270864 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:24:36.270864 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:24:36.270864 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:24:36.270864 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:24:36.270864 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:24:36.270864 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:24:36.270864 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:24:36.270864 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:24:36.270864 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:24:36.271806 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:24:36.271806 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:24:36.271806 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Sep 24 19:24:36.271806 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 447/899] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Sep 24 19:24:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:24:36.277573 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775050e8-e1f2-4450-bb8e-8a5e8c26dfa0 None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:24:36.406178 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775050e8-e1f2-4450-bb8e-8a5e8c26dfa0 None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:24:36.441632 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cbb179-2543-4ea6-811c-7cab129f9167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:24:36.442257 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cbb179-2543-4ea6-811c-7cab129f9167 None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:24:36.442547 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cbb179-2543-4ea6-811c-7cab129f9167 None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:24:36.442809 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cbb179-2543-4ea6-811c-7cab129f9167 None admin] PATH_INFO: `/v3/domains` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:24:36.443449 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cbb179-2543-4ea6-811c-7cab129f9167 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:24:36.443746 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cbb179-2543-4ea6-811c-7cab129f9167 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:24:36.445114 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cbb179-2543-4ea6-811c-7cab129f9167 None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:24:36.457164 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 453/900] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Sep 24 19:24:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:24:36.462984 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e67070f-49df-4cbb-8382-acd4b9ee99d8 None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:24:36.491853 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:24:36.570374 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e67070f-49df-4cbb-8382-acd4b9ee99d8 None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:24:36.606819 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b3ab45-e05b-4a35-96d1-09e205d0d453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:24:36.607462 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b3ab45-e05b-4a35-96d1-09e205d0d453 None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:24:36.607739 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b3ab45-e05b-4a35-96d1-09e205d0d453 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:24:36.608008 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b3ab45-e05b-4a35-96d1-09e205d0d453 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:24:36.616408 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b3ab45-e05b-4a35-96d1-09e205d0d453 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:24:36.617891 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b3ab45-e05b-4a35-96d1-09e205d0d453 None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:24:36.630441 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application [None req-b1b3ab45-e05b-4a35-96d1-09e205d0d453 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 24 19:24:36.630441 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:24:36.630441 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:24:36.630441 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:24:36.630441 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:24:36.630441 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:24:36.630441 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:24:36.630441 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:24:36.630441 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:24:36.630441 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:24:36.630441 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:24:36.630441 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:24:36.630441 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 24 19:24:36.630441 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 24 19:24:36.630441 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 24 19:24:36.630441 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 24 19:24:36.631659 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:24:36.631659 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:24:36.631659 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 24 19:24:36.631659 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 19:24:36.631659 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 24 19:24:36.631659 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 19:24:36.631659 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:24:36.631659 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:24:36.631659 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:24:36.631659 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:24:36.631659 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:24:36.631659 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application with Lock( Sep 24 19:24:36.631659 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:24:36.631659 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:24:36.631659 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:24:36.631659 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:24:36.631659 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:24:36.631659 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:24:36.632824 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:24:36.632824 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:24:36.632824 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 24 19:24:36.632824 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 24 19:24:36.632824 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 24 19:24:36.632824 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 24 19:24:36.632824 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 24 19:24:36.632824 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 24 19:24:36.632824 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 24 19:24:36.632824 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Sep 24 19:24:36.632824 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 448/901] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Sep 24 19:24:36 2022] GET /identity/v3/users/placement => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:24:36.637735 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cbb179-2543-4ea6-811c-7cab129f9167 None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:24:36.642377 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:24:36.743625 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cbb179-2543-4ea6-811c-7cab129f9167 None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:24:36.781448 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53269ce-31a1-4902-88d8-167fbf724368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:24:36.782597 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53269ce-31a1-4902-88d8-167fbf724368 None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:24:36.782880 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53269ce-31a1-4902-88d8-167fbf724368 None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:24:36.783155 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53269ce-31a1-4902-88d8-167fbf724368 None admin] PATH_INFO: `/v3/users` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:24:36.783885 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53269ce-31a1-4902-88d8-167fbf724368 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:24:36.784191 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53269ce-31a1-4902-88d8-167fbf724368 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:24:36.785609 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53269ce-31a1-4902-88d8-167fbf724368 None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:24:36.804847 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 454/902] 10.222.0.18 () {56 vars in 1143 bytes} [Sat Sep 24 19:24:36 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:24:36.810661 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b3ab45-e05b-4a35-96d1-09e205d0d453 None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:24:36.894559 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:24:36.910257 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b3ab45-e05b-4a35-96d1-09e205d0d453 None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:24:36.943164 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1669a94-4529-48ba-83a5-b7cc607a351f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:24:36.943755 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1669a94-4529-48ba-83a5-b7cc607a351f None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:24:36.944029 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1669a94-4529-48ba-83a5-b7cc607a351f None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:24:36.944295 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1669a94-4529-48ba-83a5-b7cc607a351f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:24:37.013807 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1669a94-4529-48ba-83a5-b7cc607a351f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:24:37.015385 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1669a94-4529-48ba-83a5-b7cc607a351f None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:24:37.099510 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:24:37.115885 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 449/903] 10.222.0.18 () {58 vars in 1282 bytes} [Sat Sep 24 19:24:36 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 24 19:24:37.121722 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53269ce-31a1-4902-88d8-167fbf724368 None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:24:37.186586 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:24:37.226420 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53269ce-31a1-4902-88d8-167fbf724368 None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:24:37.262534 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfea07c-2021-42b3-aef0-5c1b7b69c2f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:24:37.263155 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfea07c-2021-42b3-aef0-5c1b7b69c2f9 None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:24:37.263429 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfea07c-2021-42b3-aef0-5c1b7b69c2f9 None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:24:37.263698 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfea07c-2021-42b3-aef0-5c1b7b69c2f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:24:37.274855 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfea07c-2021-42b3-aef0-5c1b7b69c2f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:24:37.276307 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfea07c-2021-42b3-aef0-5c1b7b69c2f9 None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:24:37.290752 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application [None req-1cfea07c-2021-42b3-aef0-5c1b7b69c2f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:24:37.290752 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:24:37.290752 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:24:37.290752 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:24:37.290752 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:24:37.290752 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:24:37.290752 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:24:37.290752 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:24:37.290752 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:24:37.290752 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:24:37.290752 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:24:37.290752 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:24:37.290752 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 19:24:37.290752 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 19:24:37.290752 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 19:24:37.290752 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 19:24:37.291958 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:24:37.291958 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:24:37.291958 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:24:37.291958 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:24:37.291958 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:24:37.291958 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:24:37.291958 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:24:37.291958 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application with Lock( Sep 24 19:24:37.291958 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:24:37.291958 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:24:37.291958 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:24:37.291958 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:24:37.291958 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:24:37.291958 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:24:37.291958 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:24:37.291958 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:24:37.291958 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 19:24:37.293032 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 19:24:37.293032 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 19:24:37.293032 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Sep 24 19:24:37.293032 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 455/904] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Sep 24 19:24:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:24:37.297662 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1669a94-4529-48ba-83a5-b7cc607a351f None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:24:37.396397 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1669a94-4529-48ba-83a5-b7cc607a351f None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:24:37.431979 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5060f1b-2c11-4936-8f55-3dbd3db7c3ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:24:37.432589 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5060f1b-2c11-4936-8f55-3dbd3db7c3ce None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:24:37.432860 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5060f1b-2c11-4936-8f55-3dbd3db7c3ce None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:24:37.433126 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5060f1b-2c11-4936-8f55-3dbd3db7c3ce None admin] PATH_INFO: `/v3/domains` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:24:37.433764 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5060f1b-2c11-4936-8f55-3dbd3db7c3ce None admin] RBAC: Adding query filter params (name=Default) {{(pid=88081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:24:37.434093 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5060f1b-2c11-4936-8f55-3dbd3db7c3ce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:24:37.435475 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5060f1b-2c11-4936-8f55-3dbd3db7c3ce None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:24:37.448273 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 450/905] 10.222.0.18 () {56 vars in 1109 bytes} [Sat Sep 24 19:24:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:24:37.454735 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfea07c-2021-42b3-aef0-5c1b7b69c2f9 None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:24:37.552685 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfea07c-2021-42b3-aef0-5c1b7b69c2f9 None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:24:37.566816 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:24:37.587455 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee7e2b9-16f4-4c72-946e-f7c1ca64f4da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:24:37.588067 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee7e2b9-16f4-4c72-946e-f7c1ca64f4da None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:24:37.588343 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee7e2b9-16f4-4c72-946e-f7c1ca64f4da None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:24:37.588609 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee7e2b9-16f4-4c72-946e-f7c1ca64f4da None admin] PATH_INFO: `/v3/projects/service` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:24:37.595820 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee7e2b9-16f4-4c72-946e-f7c1ca64f4da None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:24:37.597235 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee7e2b9-16f4-4c72-946e-f7c1ca64f4da None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:24:37.608503 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application [None req-5ee7e2b9-16f4-4c72-946e-f7c1ca64f4da None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 19:24:37.608503 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:24:37.608503 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:24:37.608503 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:24:37.608503 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:24:37.608503 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:24:37.608503 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:24:37.608503 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:24:37.608503 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:24:37.608503 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:24:37.608503 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:24:37.608503 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:24:37.608503 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 24 19:24:37.608503 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 24 19:24:37.608503 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 24 19:24:37.609523 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 24 19:24:37.609523 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:24:37.609523 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:24:37.609523 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:24:37.609523 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:24:37.609523 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:24:37.609523 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:24:37.609523 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:24:37.609523 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application with Lock( Sep 24 19:24:37.609523 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:24:37.609523 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:24:37.609523 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:24:37.609523 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:24:37.609523 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:24:37.609523 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:24:37.609523 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:24:37.609523 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:24:37.611092 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 24 19:24:37.611092 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 24 19:24:37.611092 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 24 19:24:37.611092 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 24 19:24:37.611092 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 24 19:24:37.611092 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 24 19:24:37.611092 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 19:24:37.611092 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: ERROR keystone.server.flask.application Sep 24 19:24:37.611092 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 456/906] 10.222.0.18 () {56 vars in 1111 bytes} [Sat Sep 24 19:24:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:24:37.615932 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5060f1b-2c11-4936-8f55-3dbd3db7c3ce None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:24:37.662502 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:24:37.716000 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5060f1b-2c11-4936-8f55-3dbd3db7c3ce None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:24:37.749144 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d366fb-8a01-46c3-bc05-b2438d961b9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:24:37.749742 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d366fb-8a01-46c3-bc05-b2438d961b9a None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:24:37.750048 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d366fb-8a01-46c3-bc05-b2438d961b9a None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:24:37.750318 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d366fb-8a01-46c3-bc05-b2438d961b9a None admin] PATH_INFO: `/v3/projects` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:24:37.751584 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d366fb-8a01-46c3-bc05-b2438d961b9a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:24:37.751886 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d366fb-8a01-46c3-bc05-b2438d961b9a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:24:37.753291 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d366fb-8a01-46c3-bc05-b2438d961b9a None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:24:37.765214 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 451/907] 10.222.0.18 () {56 vars in 1148 bytes} [Sat Sep 24 19:24:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:24:37.771420 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee7e2b9-16f4-4c72-946e-f7c1ca64f4da None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:24:37.872931 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee7e2b9-16f4-4c72-946e-f7c1ca64f4da None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:24:37.907269 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2df523-3daa-4dfa-984e-c1195ae39efe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:24:37.907864 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2df523-3daa-4dfa-984e-c1195ae39efe None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:24:37.908136 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2df523-3daa-4dfa-984e-c1195ae39efe None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:24:37.908404 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2df523-3daa-4dfa-984e-c1195ae39efe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:24:37.909114 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2df523-3daa-4dfa-984e-c1195ae39efe None admin] RBAC: Adding query filter params (role.id=4c7d0dafc19b4b0a9821be6ec0da0a8f, scope.project.id=9dfa5c2c17244006bdd629ec81553f1a, user.id=f2dfc6ff4e9b4d30b28d39d678b19896) {{(pid=88080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:24:37.909416 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2df523-3daa-4dfa-984e-c1195ae39efe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:24:37.910863 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2df523-3daa-4dfa-984e-c1195ae39efe None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:24:37.916617 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 457/908] 10.222.0.18 () {56 vars in 1374 bytes} [Sat Sep 24 19:24:37 2022] GET /identity/v3/role_assignments?user.id=f2dfc6ff4e9b4d30b28d39d678b19896&scope.project.id=9dfa5c2c17244006bdd629ec81553f1a&role.id=4c7d0dafc19b4b0a9821be6ec0da0a8f => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:24:40.369095 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972117e1-b014-4a07-96a6-4cb4f6244093 None None] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:24:40.369644 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972117e1-b014-4a07-96a6-4cb4f6244093 None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:24:40.369644 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972117e1-b014-4a07-96a6-4cb4f6244093 None None] PATH_INFO: `/` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:24:40.371016 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 452/909] 10.222.0.18 () {54 vars in 927 bytes} [Sat Sep 24 19:24:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 24 19:24:40.377287 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62eba9f-dbc7-42b4-920a-3878ab039dfc None None] REQUEST_METHOD: `POST` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:24:40.378117 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62eba9f-dbc7-42b4-920a-3878ab039dfc None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:24:40.378117 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62eba9f-dbc7-42b4-920a-3878ab039dfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:24:40.397804 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.auth.core [None req-d62eba9f-dbc7-42b4-920a-3878ab039dfc None None] MFA Rules not processed for user `3dbbb9909cec43ff99c1c3682f016ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=88080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:24:40.399046 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.fernet_utils [None req-d62eba9f-dbc7-42b4-920a-3878ab039dfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:24:40.430197 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:24:40.471446 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 458/910] 10.222.0.18 () {58 vars in 1024 bytes} [Sat Sep 24 19:24:40 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 19:24:40.803002 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972117e1-b014-4a07-96a6-4cb4f6244093 None None] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:24:40.913359 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972117e1-b014-4a07-96a6-4cb4f6244093 None None] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:24:40.921238 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:24:40.951622 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5529bc-8e39-4b06-93ee-9ac9bba6d8d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:24:40.952298 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5529bc-8e39-4b06-93ee-9ac9bba6d8d5 None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:24:40.952635 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5529bc-8e39-4b06-93ee-9ac9bba6d8d5 None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:24:40.952924 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5529bc-8e39-4b06-93ee-9ac9bba6d8d5 None admin] PATH_INFO: `/v3/services/placement` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:24:40.953543 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5529bc-8e39-4b06-93ee-9ac9bba6d8d5 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:24:40.955008 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5529bc-8e39-4b06-93ee-9ac9bba6d8d5 None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:24:40.964314 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application [None req-9e5529bc-8e39-4b06-93ee-9ac9bba6d8d5 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 24 19:24:40.964314 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:24:40.964314 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 24 19:24:40.964314 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 24 19:24:40.964314 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 24 19:24:40.964314 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 24 19:24:40.964314 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 24 19:24:40.964314 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 19:24:40.964314 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 24 19:24:40.964314 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Sep 24 19:24:40.964314 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 24 19:24:40.964314 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Sep 24 19:24:40.964314 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:24:40.964314 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:24:40.964314 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:24:40.964314 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:24:40.964314 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:24:40.966291 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:24:40.966291 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:24:40.966291 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:24:40.966291 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:24:40.966291 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:24:40.966291 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:24:40.966291 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 24 19:24:40.966291 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 24 19:24:40.966291 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 24 19:24:40.966291 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 24 19:24:40.966291 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:24:40.966291 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:24:40.966291 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:24:40.966291 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:24:40.966291 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:24:40.966291 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:24:40.967446 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:24:40.967446 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application with Lock( Sep 24 19:24:40.967446 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:24:40.967446 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:24:40.967446 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:24:40.967446 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:24:40.967446 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:24:40.967446 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:24:40.967446 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:24:40.967446 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:24:40.967446 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 24 19:24:40.967446 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 19:24:40.967446 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 24 19:24:40.967446 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Sep 24 19:24:40.967446 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 453/911] 10.222.0.18 () {56 vars in 1117 bytes} [Sat Sep 24 19:24:40 2022] GET /identity/v3/services/placement => generated 90 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:24:40.973203 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62eba9f-dbc7-42b4-920a-3878ab039dfc None None] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:24:41.080640 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62eba9f-dbc7-42b4-920a-3878ab039dfc None None] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:24:41.120551 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2659f8f3-fe08-4108-893c-c50f1b87b839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:24:41.121228 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2659f8f3-fe08-4108-893c-c50f1b87b839 None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:24:41.121569 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2659f8f3-fe08-4108-893c-c50f1b87b839 None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:24:41.121967 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2659f8f3-fe08-4108-893c-c50f1b87b839 None admin] PATH_INFO: `/v3/services` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:24:41.122659 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2659f8f3-fe08-4108-893c-c50f1b87b839 None admin] RBAC: Adding query filter params (name=placement) {{(pid=88080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:24:41.123026 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2659f8f3-fe08-4108-893c-c50f1b87b839 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:24:41.124543 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2659f8f3-fe08-4108-893c-c50f1b87b839 None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:24:41.129955 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 459/912] 10.222.0.18 () {56 vars in 1116 bytes} [Sat Sep 24 19:24:40 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:24:41.136172 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5529bc-8e39-4b06-93ee-9ac9bba6d8d5 None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:24:41.248296 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5529bc-8e39-4b06-93ee-9ac9bba6d8d5 None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:24:41.288705 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d15116d-8c6c-4b72-9e9f-c9fd474e793c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:24:41.289061 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d15116d-8c6c-4b72-9e9f-c9fd474e793c None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:24:41.289339 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d15116d-8c6c-4b72-9e9f-c9fd474e793c None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:24:41.289609 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d15116d-8c6c-4b72-9e9f-c9fd474e793c None admin] PATH_INFO: `/v3/services` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:24:41.291916 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d15116d-8c6c-4b72-9e9f-c9fd474e793c None admin] RBAC: Adding query filter params (type=placement) {{(pid=88081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:24:41.291916 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d15116d-8c6c-4b72-9e9f-c9fd474e793c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:24:41.292162 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d15116d-8c6c-4b72-9e9f-c9fd474e793c None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:24:41.296950 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 454/913] 10.222.0.18 () {56 vars in 1116 bytes} [Sat Sep 24 19:24:41 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:24:43.817920 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35bb5ae-5e50-47f5-b390-7c50e81cdee3 None None] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:24:43.818714 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35bb5ae-5e50-47f5-b390-7c50e81cdee3 None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:24:43.818868 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35bb5ae-5e50-47f5-b390-7c50e81cdee3 None None] PATH_INFO: `/` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:24:43.820324 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 460/914] 10.222.0.18 () {54 vars in 927 bytes} [Sat Sep 24 19:24:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 24 19:24:43.826075 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f5cfda-54b8-457b-8350-4926b63dbdb3 None None] REQUEST_METHOD: `POST` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:24:43.826597 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f5cfda-54b8-457b-8350-4926b63dbdb3 None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:24:43.826597 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f5cfda-54b8-457b-8350-4926b63dbdb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:24:43.846160 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.auth.core [None req-27f5cfda-54b8-457b-8350-4926b63dbdb3 None None] MFA Rules not processed for user `3dbbb9909cec43ff99c1c3682f016ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=88081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:24:43.847368 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.fernet_utils [None req-27f5cfda-54b8-457b-8350-4926b63dbdb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:24:43.876407 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:24:43.919406 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 455/915] 10.222.0.18 () {58 vars in 1024 bytes} [Sat Sep 24 19:24:43 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 24 19:24:44.242867 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35bb5ae-5e50-47f5-b390-7c50e81cdee3 None None] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:24:44.275908 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:24:44.351623 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35bb5ae-5e50-47f5-b390-7c50e81cdee3 None None] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:24:44.392943 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495a6185-ce2f-46d1-9cd3-7cb4c07d0edf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:24:44.393550 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495a6185-ce2f-46d1-9cd3-7cb4c07d0edf None admin] REQUEST_METHOD: `POST` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:24:44.393860 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495a6185-ce2f-46d1-9cd3-7cb4c07d0edf None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:24:44.394134 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495a6185-ce2f-46d1-9cd3-7cb4c07d0edf None admin] PATH_INFO: `/v3/services` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:24:44.394834 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495a6185-ce2f-46d1-9cd3-7cb4c07d0edf None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:24:44.396219 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495a6185-ce2f-46d1-9cd3-7cb4c07d0edf None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:24:44.414203 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 461/916] 10.222.0.18 () {60 vars in 1141 bytes} [Sat Sep 24 19:24:44 2022] POST /identity/v3/services => generated 246 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 24 19:24:46.903180 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37444dc5-f309-43a6-aac3-53b833ad9b06 None None] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:24:46.903765 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37444dc5-f309-43a6-aac3-53b833ad9b06 None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:24:46.903765 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37444dc5-f309-43a6-aac3-53b833ad9b06 None None] PATH_INFO: `/` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:24:46.905081 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 456/917] 10.222.0.18 () {54 vars in 927 bytes} [Sat Sep 24 19:24:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:24:46.910723 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6332f54-44d7-4dfd-abbf-b6114eae1fd5 None None] REQUEST_METHOD: `POST` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:24:46.911188 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6332f54-44d7-4dfd-abbf-b6114eae1fd5 None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:24:46.911336 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6332f54-44d7-4dfd-abbf-b6114eae1fd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:24:46.930775 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.auth.core [None req-d6332f54-44d7-4dfd-abbf-b6114eae1fd5 None None] MFA Rules not processed for user `3dbbb9909cec43ff99c1c3682f016ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=88080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:24:46.932111 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.fernet_utils [None req-d6332f54-44d7-4dfd-abbf-b6114eae1fd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:24:47.006836 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 462/918] 10.222.0.18 () {58 vars in 1024 bytes} [Sat Sep 24 19:24:46 2022] POST /identity/v3/auth/tokens => generated 1972 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 19:24:47.323953 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37444dc5-f309-43a6-aac3-53b833ad9b06 None None] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:24:47.427881 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37444dc5-f309-43a6-aac3-53b833ad9b06 None None] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:24:47.461919 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c4dac8-4ec1-497c-a851-bb5bc64396bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:24:47.462547 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c4dac8-4ec1-497c-a851-bb5bc64396bc None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:24:47.462827 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c4dac8-4ec1-497c-a851-bb5bc64396bc None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:24:47.463094 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c4dac8-4ec1-497c-a851-bb5bc64396bc None admin] PATH_INFO: `/v3/services/placement` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:24:47.463671 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c4dac8-4ec1-497c-a851-bb5bc64396bc None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:24:47.465025 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c4dac8-4ec1-497c-a851-bb5bc64396bc None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:24:47.474025 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application [None req-64c4dac8-4ec1-497c-a851-bb5bc64396bc None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 24 19:24:47.474025 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:24:47.474025 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 24 19:24:47.474025 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 24 19:24:47.474025 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 24 19:24:47.474025 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 24 19:24:47.474025 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 24 19:24:47.474025 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 19:24:47.474025 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 24 19:24:47.474025 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Sep 24 19:24:47.474025 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 24 19:24:47.474025 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Sep 24 19:24:47.474025 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:24:47.474025 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:24:47.474025 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:24:47.474025 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:24:47.474025 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:24:47.475208 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:24:47.475208 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:24:47.475208 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:24:47.475208 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:24:47.475208 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:24:47.475208 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:24:47.475208 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 24 19:24:47.475208 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 24 19:24:47.475208 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 24 19:24:47.475208 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 24 19:24:47.475208 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:24:47.475208 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:24:47.475208 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:24:47.475208 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:24:47.475208 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:24:47.475208 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:24:47.476044 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:24:47.476044 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application with Lock( Sep 24 19:24:47.476044 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:24:47.476044 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:24:47.476044 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:24:47.476044 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:24:47.476044 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:24:47.476044 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:24:47.476044 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:24:47.476044 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:24:47.476044 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 24 19:24:47.476044 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 19:24:47.476044 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 24 19:24:47.476044 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Sep 24 19:24:47.476044 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 457/919] 10.222.0.18 () {56 vars in 1117 bytes} [Sat Sep 24 19:24:47 2022] GET /identity/v3/services/placement => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:24:47.481446 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6332f54-44d7-4dfd-abbf-b6114eae1fd5 None None] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:24:47.499951 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:24:47.584510 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6332f54-44d7-4dfd-abbf-b6114eae1fd5 None None] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:24:47.620470 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40469799-419c-453e-a125-e0eb9fb3b345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:24:47.621085 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40469799-419c-453e-a125-e0eb9fb3b345 None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:24:47.621365 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40469799-419c-453e-a125-e0eb9fb3b345 None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:24:47.621635 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40469799-419c-453e-a125-e0eb9fb3b345 None admin] PATH_INFO: `/v3/services` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:24:47.622299 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40469799-419c-453e-a125-e0eb9fb3b345 None admin] RBAC: Adding query filter params (name=placement) {{(pid=88080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:24:47.622602 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40469799-419c-453e-a125-e0eb9fb3b345 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:24:47.623970 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40469799-419c-453e-a125-e0eb9fb3b345 None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:24:47.629652 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 463/920] 10.222.0.18 () {56 vars in 1116 bytes} [Sat Sep 24 19:24:47 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:24:47.635819 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c4dac8-4ec1-497c-a851-bb5bc64396bc None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:24:47.664283 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:24:47.740578 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c4dac8-4ec1-497c-a851-bb5bc64396bc None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:24:47.782043 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2cef5b-1b28-4ac3-8099-6a7e0efa8f7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:24:47.783150 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2cef5b-1b28-4ac3-8099-6a7e0efa8f7a None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:24:47.783426 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2cef5b-1b28-4ac3-8099-6a7e0efa8f7a None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:24:47.783689 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2cef5b-1b28-4ac3-8099-6a7e0efa8f7a None admin] PATH_INFO: `/v3/endpoints` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:24:47.784382 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2cef5b-1b28-4ac3-8099-6a7e0efa8f7a None admin] RBAC: Adding query filter params (interface=public, service_id=49bc8f11f15f47079df339b508b04ef9, region_id=RegionOne) {{(pid=88081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:24:47.784682 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2cef5b-1b28-4ac3-8099-6a7e0efa8f7a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:24:47.786049 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2cef5b-1b28-4ac3-8099-6a7e0efa8f7a None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:24:47.791458 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 458/921] 10.222.0.18 () {56 vars in 1251 bytes} [Sat Sep 24 19:24:47 2022] GET /identity/v3/endpoints?service_id=49bc8f11f15f47079df339b508b04ef9&interface=public®ion_id=RegionOne => generated 194 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:24:47.797220 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40469799-419c-453e-a125-e0eb9fb3b345 None admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:24:47.885609 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:24:47.906350 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40469799-419c-453e-a125-e0eb9fb3b345 None admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:24:47.944709 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cee1c8-83ad-418f-99e2-6c853423e1d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:24:47.945374 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cee1c8-83ad-418f-99e2-6c853423e1d6 None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:24:47.945599 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cee1c8-83ad-418f-99e2-6c853423e1d6 None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:24:47.945895 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cee1c8-83ad-418f-99e2-6c853423e1d6 None admin] PATH_INFO: `/v3/services` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:24:47.946511 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cee1c8-83ad-418f-99e2-6c853423e1d6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:24:47.947886 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cee1c8-83ad-418f-99e2-6c853423e1d6 None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:24:47.955009 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 464/922] 10.222.0.18 () {56 vars in 1087 bytes} [Sat Sep 24 19:24:47 2022] GET /identity/v3/services => generated 1962 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 19:24:50.404254 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ed70a5-71b7-41fe-ae10-f68793631bbc None None] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:24:50.404798 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ed70a5-71b7-41fe-ae10-f68793631bbc None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:24:50.404798 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ed70a5-71b7-41fe-ae10-f68793631bbc None None] PATH_INFO: `/` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:24:50.406271 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 459/923] 10.222.0.18 () {54 vars in 927 bytes} [Sat Sep 24 19:24:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:24:50.412652 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d5e936-20f2-44fb-b755-c216d4b192b7 None None] REQUEST_METHOD: `POST` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:24:50.413268 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d5e936-20f2-44fb-b755-c216d4b192b7 None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:24:50.413268 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d5e936-20f2-44fb-b755-c216d4b192b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:24:50.431409 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.auth.core [None req-93d5e936-20f2-44fb-b755-c216d4b192b7 None None] MFA Rules not processed for user `3dbbb9909cec43ff99c1c3682f016ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=88080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:24:50.432601 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.fernet_utils [None req-93d5e936-20f2-44fb-b755-c216d4b192b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:24:50.509117 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 465/924] 10.222.0.18 () {58 vars in 1024 bytes} [Sat Sep 24 19:24:50 2022] POST /identity/v3/auth/tokens => generated 1972 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 24 19:24:50.835524 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ed70a5-71b7-41fe-ae10-f68793631bbc None None] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:24:50.931655 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:24:50.942335 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ed70a5-71b7-41fe-ae10-f68793631bbc None None] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:24:50.979234 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763d7181-0da1-48fa-bd22-7bce3a29b09d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:24:50.979870 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763d7181-0da1-48fa-bd22-7bce3a29b09d None admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:24:50.980143 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763d7181-0da1-48fa-bd22-7bce3a29b09d None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:24:50.980406 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763d7181-0da1-48fa-bd22-7bce3a29b09d None admin] PATH_INFO: `/v3/services/placement` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:24:50.980982 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763d7181-0da1-48fa-bd22-7bce3a29b09d None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:24:50.982382 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763d7181-0da1-48fa-bd22-7bce3a29b09d None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:24:50.992077 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application [None req-763d7181-0da1-48fa-bd22-7bce3a29b09d None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 24 19:24:50.992077 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:24:50.992077 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 24 19:24:50.992077 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 24 19:24:50.992077 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 24 19:24:50.992077 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 24 19:24:50.992077 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 24 19:24:50.992077 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 19:24:50.992077 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 24 19:24:50.992077 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Sep 24 19:24:50.992077 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 24 19:24:50.992077 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Sep 24 19:24:50.992077 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 19:24:50.992077 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 19:24:50.992077 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 19:24:50.992077 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 19:24:50.992077 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 19:24:50.993797 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 19:24:50.993797 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 19:24:50.993797 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 19:24:50.993797 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 19:24:50.993797 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 19:24:50.993797 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 19:24:50.993797 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 24 19:24:50.993797 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 24 19:24:50.993797 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 24 19:24:50.993797 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 24 19:24:50.993797 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 19:24:50.993797 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 19:24:50.993797 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 19:24:50.993797 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 19:24:50.993797 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 19:24:50.993797 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 19:24:50.994789 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 19:24:50.994789 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application with Lock( Sep 24 19:24:50.994789 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 19:24:50.994789 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self._enter() Sep 24 19:24:50.994789 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 19:24:50.994789 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 19:24:50.994789 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 19:24:50.994789 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application return self.creator() Sep 24 19:24:50.994789 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 19:24:50.994789 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application created_value = creator( Sep 24 19:24:50.994789 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 24 19:24:50.994789 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 19:24:50.994789 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 24 19:24:50.994789 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: ERROR keystone.server.flask.application Sep 24 19:24:50.994789 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 460/925] 10.222.0.18 () {56 vars in 1117 bytes} [Sat Sep 24 19:24:50 2022] GET /identity/v3/services/placement => generated 90 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 19:24:51.000227 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d5e936-20f2-44fb-b755-c216d4b192b7 None None] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:24:51.127251 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:24:51.150560 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d5e936-20f2-44fb-b755-c216d4b192b7 None None] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:24:51.186015 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da2ec20-40fb-451e-a6c2-c52b9c5214a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:24:51.186626 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da2ec20-40fb-451e-a6c2-c52b9c5214a0 None admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:24:51.186914 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da2ec20-40fb-451e-a6c2-c52b9c5214a0 None admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:24:51.187181 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da2ec20-40fb-451e-a6c2-c52b9c5214a0 None admin] PATH_INFO: `/v3/services` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:24:51.187809 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da2ec20-40fb-451e-a6c2-c52b9c5214a0 None admin] RBAC: Adding query filter params (name=placement) {{(pid=88080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:24:51.188112 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da2ec20-40fb-451e-a6c2-c52b9c5214a0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:24:51.189478 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da2ec20-40fb-451e-a6c2-c52b9c5214a0 None admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:24:51.194663 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 466/926] 10.222.0.18 () {56 vars in 1116 bytes} [Sat Sep 24 19:24:50 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:24:51.200509 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763d7181-0da1-48fa-bd22-7bce3a29b09d None admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:24:51.301036 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763d7181-0da1-48fa-bd22-7bce3a29b09d None admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:24:51.337846 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fadac56-d91f-45fa-8cc2-d01e8b04473e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:24:51.338473 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fadac56-d91f-45fa-8cc2-d01e8b04473e None admin] REQUEST_METHOD: `POST` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:24:51.338945 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fadac56-d91f-45fa-8cc2-d01e8b04473e None admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:24:51.339212 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fadac56-d91f-45fa-8cc2-d01e8b04473e None admin] PATH_INFO: `/v3/endpoints` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:24:51.339897 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fadac56-d91f-45fa-8cc2-d01e8b04473e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:24:51.341293 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fadac56-d91f-45fa-8cc2-d01e8b04473e None admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:24:51.362670 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 461/927] 10.222.0.18 () {60 vars in 1144 bytes} [Sat Sep 24 19:24:51 2022] POST /identity/v3/endpoints => generated 331 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 24 19:25:01.192029 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=30 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:25:01.358133 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=93,keystone:INSERT=1 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:25:56.241984 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f75cc8-73aa-4928-95da-7a9c99cd221c None None] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:25:56.242627 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f75cc8-73aa-4928-95da-7a9c99cd221c None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:25:56.242627 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f75cc8-73aa-4928-95da-7a9c99cd221c None None] PATH_INFO: `/` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:25:56.244215 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 467/928] 10.222.0.18 () {54 vars in 927 bytes} [Sat Sep 24 19:25:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:25:56.250044 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36655fda-6bbd-415b-9c6d-0e965e4a3394 None None] REQUEST_METHOD: `POST` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:25:56.250495 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36655fda-6bbd-415b-9c6d-0e965e4a3394 None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:25:56.250495 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36655fda-6bbd-415b-9c6d-0e965e4a3394 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:25:56.277538 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.auth.core [None req-36655fda-6bbd-415b-9c6d-0e965e4a3394 None None] MFA Rules not processed for user `3dbbb9909cec43ff99c1c3682f016ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=88081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:25:56.279765 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.fernet_utils [None req-36655fda-6bbd-415b-9c6d-0e965e4a3394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:25:56.363233 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 462/929] 10.222.0.18 () {58 vars in 1024 bytes} [Sat Sep 24 19:25:56 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:25:56.711004 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be0bd1b-ca64-4fdf-8be1-ffa62d3fb501 None None] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:25:56.711283 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be0bd1b-ca64-4fdf-8be1-ffa62d3fb501 None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:25:56.711552 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be0bd1b-ca64-4fdf-8be1-ffa62d3fb501 None None] PATH_INFO: `/` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:25:56.712896 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 468/930] 10.222.0.18 () {54 vars in 964 bytes} [Sat Sep 24 19:25:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:25:56.719254 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d92acf1-9467-4d37-b89e-e67acfe9ab59 None None] REQUEST_METHOD: `POST` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:25:56.719545 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d92acf1-9467-4d37-b89e-e67acfe9ab59 None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:25:56.719871 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d92acf1-9467-4d37-b89e-e67acfe9ab59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:25:56.789790 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.auth.core [None req-6d92acf1-9467-4d37-b89e-e67acfe9ab59 None None] MFA Rules not processed for user `2ef291c173794b49ade9469a5ef72e08`. Rule list: `[]` (Enabled: `True`). {{(pid=88081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:25:56.791052 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.fernet_utils [None req-6d92acf1-9467-4d37-b89e-e67acfe9ab59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:25:56.853916 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 463/931] 10.222.0.18 () {58 vars in 1061 bytes} [Sat Sep 24 19:25:56 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 19:25:56.863750 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be0bd1b-ca64-4fdf-8be1-ffa62d3fb501 None None] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:25:56.875321 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be0bd1b-ca64-4fdf-8be1-ffa62d3fb501 None None] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:25:56.878784 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec55678-3ad1-4136-a492-db2bae19c450 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ef291c173794b49ade9469a5ef72e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dfa5c2c17244006bdd629ec81553f1a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:25:56.879376 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec55678-3ad1-4136-a492-db2bae19c450 service neutron] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:25:56.879656 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec55678-3ad1-4136-a492-db2bae19c450 service neutron] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:25:56.879928 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec55678-3ad1-4136-a492-db2bae19c450 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:25:56.890987 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec55678-3ad1-4136-a492-db2bae19c450 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:25:56.893582 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec55678-3ad1-4136-a492-db2bae19c450 service neutron] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:25:56.904267 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 469/932] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Sep 24 19:25:56 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:25:59.720844 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef61e43-9dce-4042-90fe-607acab8a362 None None] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:25:59.721417 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef61e43-9dce-4042-90fe-607acab8a362 None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:25:59.721417 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef61e43-9dce-4042-90fe-607acab8a362 None None] PATH_INFO: `/` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:25:59.722730 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 464/933] 10.222.0.18 () {54 vars in 927 bytes} [Sat Sep 24 19:25:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:25:59.728568 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aae04db-518c-4bcb-980f-ab23c5a10ca9 None None] REQUEST_METHOD: `POST` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:25:59.729017 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aae04db-518c-4bcb-980f-ab23c5a10ca9 None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:25:59.729118 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aae04db-518c-4bcb-980f-ab23c5a10ca9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:25:59.748776 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.auth.core [None req-7aae04db-518c-4bcb-980f-ab23c5a10ca9 None None] MFA Rules not processed for user `3dbbb9909cec43ff99c1c3682f016ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=88080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:25:59.750005 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.fernet_utils [None req-7aae04db-518c-4bcb-980f-ab23c5a10ca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:25:59.758623 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 470/934] 10.222.0.18 () {58 vars in 1024 bytes} [Sat Sep 24 19:25:59 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:26:00.095199 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef61e43-9dce-4042-90fe-607acab8a362 None None] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:26:00.105982 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef61e43-9dce-4042-90fe-607acab8a362 None None] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:26:00.109441 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ac3f93-6dd3-4645-bb86-37f8ce117d81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ef291c173794b49ade9469a5ef72e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dfa5c2c17244006bdd629ec81553f1a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:26:00.110086 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ac3f93-6dd3-4645-bb86-37f8ce117d81 service neutron] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:26:00.110366 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ac3f93-6dd3-4645-bb86-37f8ce117d81 service neutron] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:26:00.110642 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ac3f93-6dd3-4645-bb86-37f8ce117d81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:26:00.120523 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ac3f93-6dd3-4645-bb86-37f8ce117d81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:26:00.121985 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ac3f93-6dd3-4645-bb86-37f8ce117d81 service neutron] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:26:00.132512 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 465/935] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Sep 24 19:26:00 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:26:02.891251 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e7a8f5-aee3-409d-91e1-0258e4b2a01f None None] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:26:02.891771 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e7a8f5-aee3-409d-91e1-0258e4b2a01f None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:26:02.891771 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e7a8f5-aee3-409d-91e1-0258e4b2a01f None None] PATH_INFO: `/` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:26:02.894395 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 471/936] 10.222.0.18 () {54 vars in 927 bytes} [Sat Sep 24 19:26:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:26:02.899115 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f909dedd-8709-401a-b2de-e495a48fc302 None None] REQUEST_METHOD: `POST` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:26:02.899557 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f909dedd-8709-401a-b2de-e495a48fc302 None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:26:02.899632 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f909dedd-8709-401a-b2de-e495a48fc302 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:26:02.939756 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.auth.core [None req-f909dedd-8709-401a-b2de-e495a48fc302 None None] MFA Rules not processed for user `6fe4c395bf344558954904e47a38c49e`. Rule list: `[]` (Enabled: `True`). {{(pid=88081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:26:02.941126 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.fernet_utils [None req-f909dedd-8709-401a-b2de-e495a48fc302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:26:02.988972 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:26:03.022631 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 466/937] 10.222.0.18 () {58 vars in 1024 bytes} [Sat Sep 24 19:26:02 2022] POST /identity/v3/auth/tokens => generated 2803 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:26:03.416597 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c973e7e-d5ea-4bc8-b111-b8c986ac0ded None None] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:26:03.416961 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c973e7e-d5ea-4bc8-b111-b8c986ac0ded None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:26:03.417317 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c973e7e-d5ea-4bc8-b111-b8c986ac0ded None None] PATH_INFO: `/` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:26:03.418783 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 472/938] 10.222.0.18 () {54 vars in 964 bytes} [Sat Sep 24 19:26:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:26:03.425306 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f208dcf0-f453-4a35-bc96-a7da5d0d630f None None] REQUEST_METHOD: `POST` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:26:03.425674 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f208dcf0-f453-4a35-bc96-a7da5d0d630f None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:26:03.426050 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f208dcf0-f453-4a35-bc96-a7da5d0d630f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:26:03.449635 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.auth.core [None req-f208dcf0-f453-4a35-bc96-a7da5d0d630f None None] MFA Rules not processed for user `2ef291c173794b49ade9469a5ef72e08`. Rule list: `[]` (Enabled: `True`). {{(pid=88081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:26:03.450854 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.fernet_utils [None req-f208dcf0-f453-4a35-bc96-a7da5d0d630f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:26:03.457404 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 467/939] 10.222.0.18 () {58 vars in 1061 bytes} [Sat Sep 24 19:26:03 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:26:03.466010 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c973e7e-d5ea-4bc8-b111-b8c986ac0ded None None] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:26:03.477334 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c973e7e-d5ea-4bc8-b111-b8c986ac0ded None None] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:26:03.481542 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed10c960-aaba-4e54-8802-385c255b1918 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ef291c173794b49ade9469a5ef72e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dfa5c2c17244006bdd629ec81553f1a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:26:03.482185 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed10c960-aaba-4e54-8802-385c255b1918 service neutron] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:26:03.482525 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed10c960-aaba-4e54-8802-385c255b1918 service neutron] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:26:03.482794 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed10c960-aaba-4e54-8802-385c255b1918 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:26:03.493682 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed10c960-aaba-4e54-8802-385c255b1918 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:26:03.495236 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed10c960-aaba-4e54-8802-385c255b1918 service neutron] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:26:03.508964 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 473/940] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Sep 24 19:26:03 2022] GET /identity/v3/auth/tokens => generated 2803 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:26:06.933981 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96670c74-b960-4eef-90bd-9bc6dd24183e None None] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:26:06.934513 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96670c74-b960-4eef-90bd-9bc6dd24183e None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:26:06.934513 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96670c74-b960-4eef-90bd-9bc6dd24183e None None] PATH_INFO: `/` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:26:06.935905 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 468/941] 10.222.0.18 () {54 vars in 927 bytes} [Sat Sep 24 19:26:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:26:06.941438 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0340fce1-be19-45cd-8828-30226fc5f644 None None] REQUEST_METHOD: `POST` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:26:06.941893 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0340fce1-be19-45cd-8828-30226fc5f644 None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:26:06.941998 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0340fce1-be19-45cd-8828-30226fc5f644 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:26:06.964125 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.auth.core [None req-0340fce1-be19-45cd-8828-30226fc5f644 None None] MFA Rules not processed for user `3dbbb9909cec43ff99c1c3682f016ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=88080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:26:06.965341 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.fernet_utils [None req-0340fce1-be19-45cd-8828-30226fc5f644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:26:07.045156 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 474/942] 10.222.0.18 () {58 vars in 1024 bytes} [Sat Sep 24 19:26:06 2022] POST /identity/v3/auth/tokens => generated 2798 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:26:07.395019 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96670c74-b960-4eef-90bd-9bc6dd24183e None None] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:26:07.406150 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96670c74-b960-4eef-90bd-9bc6dd24183e None None] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:26:07.409512 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219dedb8-5f4d-42cc-9a34-d891dd3cb4d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ef291c173794b49ade9469a5ef72e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dfa5c2c17244006bdd629ec81553f1a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:26:07.410126 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219dedb8-5f4d-42cc-9a34-d891dd3cb4d1 service neutron] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:26:07.410402 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219dedb8-5f4d-42cc-9a34-d891dd3cb4d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:26:07.410671 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219dedb8-5f4d-42cc-9a34-d891dd3cb4d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:26:07.419278 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219dedb8-5f4d-42cc-9a34-d891dd3cb4d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:26:07.420672 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219dedb8-5f4d-42cc-9a34-d891dd3cb4d1 service neutron] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:26:07.429960 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 469/943] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Sep 24 19:26:07 2022] GET /identity/v3/auth/tokens => generated 2798 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:26:10.606325 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507e5557-643c-4ab4-ba66-25f85acf2799 None None] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:26:10.606874 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507e5557-643c-4ab4-ba66-25f85acf2799 None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:26:10.606874 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507e5557-643c-4ab4-ba66-25f85acf2799 None None] PATH_INFO: `/` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:26:10.608190 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 475/944] 10.222.0.18 () {54 vars in 927 bytes} [Sat Sep 24 19:26:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:26:10.613485 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7d65d5-8da7-43f9-bef7-985085ed4f51 None None] REQUEST_METHOD: `POST` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:26:10.613950 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7d65d5-8da7-43f9-bef7-985085ed4f51 None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:26:10.614072 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7d65d5-8da7-43f9-bef7-985085ed4f51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:26:10.634893 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.auth.core [None req-6e7d65d5-8da7-43f9-bef7-985085ed4f51 None None] MFA Rules not processed for user `3dbbb9909cec43ff99c1c3682f016ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=88081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:26:10.636085 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.fernet_utils [None req-6e7d65d5-8da7-43f9-bef7-985085ed4f51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:26:10.643943 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 470/945] 10.222.0.18 () {58 vars in 1024 bytes} [Sat Sep 24 19:26:10 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:26:10.977307 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507e5557-643c-4ab4-ba66-25f85acf2799 None None] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:26:10.987804 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507e5557-643c-4ab4-ba66-25f85acf2799 None None] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:26:10.991502 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b7adfd-3b4a-41e5-a305-70d2e0beeabb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ef291c173794b49ade9469a5ef72e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dfa5c2c17244006bdd629ec81553f1a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:26:10.992083 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b7adfd-3b4a-41e5-a305-70d2e0beeabb service neutron] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:26:10.992356 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b7adfd-3b4a-41e5-a305-70d2e0beeabb service neutron] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:26:10.992621 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b7adfd-3b4a-41e5-a305-70d2e0beeabb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:26:11.004172 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b7adfd-3b4a-41e5-a305-70d2e0beeabb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:26:11.005600 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b7adfd-3b4a-41e5-a305-70d2e0beeabb service neutron] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:26:11.016268 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 476/946] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Sep 24 19:26:10 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:26:13.511219 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de450914-2dbc-4985-8980-c7d058ff1d1b None None] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:26:13.511602 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de450914-2dbc-4985-8980-c7d058ff1d1b None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:26:13.511764 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de450914-2dbc-4985-8980-c7d058ff1d1b None None] PATH_INFO: `/` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:26:13.513497 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 471/947] 10.222.0.18 () {54 vars in 927 bytes} [Sat Sep 24 19:26:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:26:13.519214 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03487a3c-14dc-4679-b938-0d7300846c94 None None] REQUEST_METHOD: `POST` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:26:13.519684 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03487a3c-14dc-4679-b938-0d7300846c94 None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:26:13.519776 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03487a3c-14dc-4679-b938-0d7300846c94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:26:13.539554 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.auth.core [None req-03487a3c-14dc-4679-b938-0d7300846c94 None None] MFA Rules not processed for user `3dbbb9909cec43ff99c1c3682f016ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=88080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:26:13.540739 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.fernet_utils [None req-03487a3c-14dc-4679-b938-0d7300846c94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:26:13.548519 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 477/948] 10.222.0.18 () {58 vars in 1024 bytes} [Sat Sep 24 19:26:13 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:26:13.883066 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de450914-2dbc-4985-8980-c7d058ff1d1b None None] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:26:13.895053 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de450914-2dbc-4985-8980-c7d058ff1d1b None None] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:26:13.899221 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16964eda-d18c-434d-a3c4-d0ea2da89459 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ef291c173794b49ade9469a5ef72e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dfa5c2c17244006bdd629ec81553f1a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:26:13.899815 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16964eda-d18c-434d-a3c4-d0ea2da89459 service neutron] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:26:13.900088 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16964eda-d18c-434d-a3c4-d0ea2da89459 service neutron] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:26:13.900403 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16964eda-d18c-434d-a3c4-d0ea2da89459 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:26:13.909483 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16964eda-d18c-434d-a3c4-d0ea2da89459 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:26:13.910938 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16964eda-d18c-434d-a3c4-d0ea2da89459 service neutron] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:26:13.921097 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 472/949] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Sep 24 19:26:13 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:26:16.406896 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87591c9-374c-4a85-8e92-09ea4e4b9991 None None] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:26:16.407431 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87591c9-374c-4a85-8e92-09ea4e4b9991 None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:26:16.407431 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87591c9-374c-4a85-8e92-09ea4e4b9991 None None] PATH_INFO: `/` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:26:16.408753 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 478/950] 10.222.0.18 () {54 vars in 927 bytes} [Sat Sep 24 19:26:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:26:16.414580 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097d4653-385e-4048-9322-d57277956e53 None None] REQUEST_METHOD: `POST` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:26:16.415019 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097d4653-385e-4048-9322-d57277956e53 None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:26:16.415098 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097d4653-385e-4048-9322-d57277956e53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:26:16.434502 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.auth.core [None req-097d4653-385e-4048-9322-d57277956e53 None None] MFA Rules not processed for user `6fe4c395bf344558954904e47a38c49e`. Rule list: `[]` (Enabled: `True`). {{(pid=88081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:26:16.435673 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.fernet_utils [None req-097d4653-385e-4048-9322-d57277956e53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:26:16.443752 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 473/951] 10.222.0.18 () {58 vars in 1024 bytes} [Sat Sep 24 19:26:16 2022] POST /identity/v3/auth/tokens => generated 2803 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:26:16.784947 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87591c9-374c-4a85-8e92-09ea4e4b9991 None None] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:26:16.796679 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87591c9-374c-4a85-8e92-09ea4e4b9991 None None] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:26:16.800228 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4758a9fb-8034-43ea-8127-50d1f5aeb69a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ef291c173794b49ade9469a5ef72e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dfa5c2c17244006bdd629ec81553f1a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:26:16.800835 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4758a9fb-8034-43ea-8127-50d1f5aeb69a service neutron] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:26:16.801110 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4758a9fb-8034-43ea-8127-50d1f5aeb69a service neutron] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:26:16.801382 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4758a9fb-8034-43ea-8127-50d1f5aeb69a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:26:16.811077 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4758a9fb-8034-43ea-8127-50d1f5aeb69a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:26:16.812514 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4758a9fb-8034-43ea-8127-50d1f5aeb69a service neutron] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:26:16.822216 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 479/952] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Sep 24 19:26:16 2022] GET /identity/v3/auth/tokens => generated 2803 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:26:19.471443 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f55bf93-fcb6-4231-9183-b321447ee66a None None] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:26:19.471991 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f55bf93-fcb6-4231-9183-b321447ee66a None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:26:19.471991 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f55bf93-fcb6-4231-9183-b321447ee66a None None] PATH_INFO: `/` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:26:19.473340 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 474/953] 10.222.0.18 () {54 vars in 927 bytes} [Sat Sep 24 19:26:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:26:19.479341 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4979212-28e6-4dfd-a94b-7dcf31cd71ac None None] REQUEST_METHOD: `POST` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:26:19.479836 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4979212-28e6-4dfd-a94b-7dcf31cd71ac None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:26:19.479929 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4979212-28e6-4dfd-a94b-7dcf31cd71ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:26:19.499808 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.auth.core [None req-c4979212-28e6-4dfd-a94b-7dcf31cd71ac None None] MFA Rules not processed for user `3dbbb9909cec43ff99c1c3682f016ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=88080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:26:19.500980 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.fernet_utils [None req-c4979212-28e6-4dfd-a94b-7dcf31cd71ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:26:19.508621 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 480/954] 10.222.0.18 () {58 vars in 1024 bytes} [Sat Sep 24 19:26:19 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:26:19.845276 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f55bf93-fcb6-4231-9183-b321447ee66a None None] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:26:19.858840 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f55bf93-fcb6-4231-9183-b321447ee66a None None] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:26:19.862292 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f4cd92-cfd1-4b78-8542-2f13191cd333 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ef291c173794b49ade9469a5ef72e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dfa5c2c17244006bdd629ec81553f1a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:26:19.862292 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f4cd92-cfd1-4b78-8542-2f13191cd333 service neutron] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:26:19.872495 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f4cd92-cfd1-4b78-8542-2f13191cd333 service neutron] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:26:19.872495 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f4cd92-cfd1-4b78-8542-2f13191cd333 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:26:19.883428 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f4cd92-cfd1-4b78-8542-2f13191cd333 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:26:19.884857 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f4cd92-cfd1-4b78-8542-2f13191cd333 service neutron] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:26:19.894495 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 475/955] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Sep 24 19:26:19 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:26:22.389526 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93069e66-f3cb-45b5-99ca-725f05a0d82a None None] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:26:22.390001 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93069e66-f3cb-45b5-99ca-725f05a0d82a None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:26:22.390088 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93069e66-f3cb-45b5-99ca-725f05a0d82a None None] PATH_INFO: `/` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:26:22.391434 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 481/956] 10.222.0.18 () {54 vars in 927 bytes} [Sat Sep 24 19:26:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:26:22.396935 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bbc8f6-317e-4d94-8df6-3c68c2b2b2dd None None] REQUEST_METHOD: `POST` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:26:22.397325 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bbc8f6-317e-4d94-8df6-3c68c2b2b2dd None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:26:22.397485 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bbc8f6-317e-4d94-8df6-3c68c2b2b2dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:26:22.417234 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.auth.core [None req-a1bbc8f6-317e-4d94-8df6-3c68c2b2b2dd None None] MFA Rules not processed for user `3dbbb9909cec43ff99c1c3682f016ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=88081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:26:22.418473 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.fernet_utils [None req-a1bbc8f6-317e-4d94-8df6-3c68c2b2b2dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:26:22.426514 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 476/957] 10.222.0.18 () {58 vars in 1024 bytes} [Sat Sep 24 19:26:22 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:26:22.774350 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93069e66-f3cb-45b5-99ca-725f05a0d82a None None] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:26:22.786893 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=65 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:26:22.793941 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93069e66-f3cb-45b5-99ca-725f05a0d82a None None] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:26:22.797464 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e531f9-1b32-4375-a407-d7c385e1cb98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ef291c173794b49ade9469a5ef72e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dfa5c2c17244006bdd629ec81553f1a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:26:22.798118 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e531f9-1b32-4375-a407-d7c385e1cb98 service neutron] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:26:22.798394 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e531f9-1b32-4375-a407-d7c385e1cb98 service neutron] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:26:22.798662 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e531f9-1b32-4375-a407-d7c385e1cb98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:26:22.807896 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e531f9-1b32-4375-a407-d7c385e1cb98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:26:22.809313 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e531f9-1b32-4375-a407-d7c385e1cb98 service neutron] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:26:22.819061 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 482/958] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Sep 24 19:26:22 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:26:25.558980 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cb34d9-9711-4343-8e90-42192813f497 None None] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:26:25.559513 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cb34d9-9711-4343-8e90-42192813f497 None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:26:25.559513 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cb34d9-9711-4343-8e90-42192813f497 None None] PATH_INFO: `/` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:26:25.560844 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 477/959] 10.222.0.18 () {54 vars in 927 bytes} [Sat Sep 24 19:26:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:26:25.566397 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915441d9-0fb2-4804-a1ab-c5483b914432 None None] REQUEST_METHOD: `POST` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:26:25.566911 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915441d9-0fb2-4804-a1ab-c5483b914432 None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:26:25.566911 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915441d9-0fb2-4804-a1ab-c5483b914432 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:26:25.589977 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.auth.core [None req-915441d9-0fb2-4804-a1ab-c5483b914432 None None] MFA Rules not processed for user `3dbbb9909cec43ff99c1c3682f016ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=88080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:26:25.591202 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.fernet_utils [None req-915441d9-0fb2-4804-a1ab-c5483b914432 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:26:25.599108 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 483/960] 10.222.0.18 () {58 vars in 1024 bytes} [Sat Sep 24 19:26:25 2022] POST /identity/v3/auth/tokens => generated 2798 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:26:25.932697 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cb34d9-9711-4343-8e90-42192813f497 None None] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:26:25.943187 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cb34d9-9711-4343-8e90-42192813f497 None None] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:26:25.947548 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2034c692-3be4-4807-9003-5a31bf40e175 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ef291c173794b49ade9469a5ef72e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dfa5c2c17244006bdd629ec81553f1a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:26:25.948141 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2034c692-3be4-4807-9003-5a31bf40e175 service neutron] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:26:25.948412 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2034c692-3be4-4807-9003-5a31bf40e175 service neutron] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:26:25.948677 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2034c692-3be4-4807-9003-5a31bf40e175 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:26:25.957890 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2034c692-3be4-4807-9003-5a31bf40e175 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:26:25.959292 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2034c692-3be4-4807-9003-5a31bf40e175 service neutron] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:26:25.969157 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 478/961] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Sep 24 19:26:25 2022] GET /identity/v3/auth/tokens => generated 2798 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:26:30.459938 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69211e2d-f4d3-4902-b1cb-c7aea0ee8ddf None None] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:26:30.460524 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69211e2d-f4d3-4902-b1cb-c7aea0ee8ddf None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:26:30.460524 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69211e2d-f4d3-4902-b1cb-c7aea0ee8ddf None None] PATH_INFO: `/` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:26:30.461788 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 484/962] 10.222.0.18 () {54 vars in 927 bytes} [Sat Sep 24 19:26:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:26:30.467203 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47818f90-46e4-473a-bba9-63aec64cc43d None None] REQUEST_METHOD: `POST` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:26:30.467651 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47818f90-46e4-473a-bba9-63aec64cc43d None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:26:30.467848 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47818f90-46e4-473a-bba9-63aec64cc43d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:26:30.487764 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.auth.core [None req-47818f90-46e4-473a-bba9-63aec64cc43d None None] MFA Rules not processed for user `3dbbb9909cec43ff99c1c3682f016ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=88081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:26:30.488916 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.fernet_utils [None req-47818f90-46e4-473a-bba9-63aec64cc43d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:26:30.497585 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 479/963] 10.222.0.18 () {58 vars in 1024 bytes} [Sat Sep 24 19:26:30 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:26:30.846152 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69211e2d-f4d3-4902-b1cb-c7aea0ee8ddf None None] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:26:30.857783 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69211e2d-f4d3-4902-b1cb-c7aea0ee8ddf None None] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:26:30.861470 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e194851-c70f-4af4-a0dd-392f18ce838f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ef291c173794b49ade9469a5ef72e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dfa5c2c17244006bdd629ec81553f1a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:26:30.862107 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e194851-c70f-4af4-a0dd-392f18ce838f service neutron] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:26:30.862385 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e194851-c70f-4af4-a0dd-392f18ce838f service neutron] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:26:30.862656 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e194851-c70f-4af4-a0dd-392f18ce838f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:26:30.872965 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e194851-c70f-4af4-a0dd-392f18ce838f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:26:30.874475 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e194851-c70f-4af4-a0dd-392f18ce838f service neutron] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:26:30.884609 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 485/964] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Sep 24 19:26:30 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:26:33.934559 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d086bf-cfd8-4a2f-bfd5-79264c98f35f None None] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:26:33.935097 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d086bf-cfd8-4a2f-bfd5-79264c98f35f None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:26:33.935097 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d086bf-cfd8-4a2f-bfd5-79264c98f35f None None] PATH_INFO: `/` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:26:33.936401 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 480/965] 10.222.0.18 () {54 vars in 927 bytes} [Sat Sep 24 19:26:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:26:33.941550 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9724056-6775-4775-90c8-8457947cefe3 None None] REQUEST_METHOD: `POST` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:26:33.941957 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9724056-6775-4775-90c8-8457947cefe3 None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:26:33.942271 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9724056-6775-4775-90c8-8457947cefe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:26:33.963397 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.auth.core [None req-b9724056-6775-4775-90c8-8457947cefe3 None None] MFA Rules not processed for user `3dbbb9909cec43ff99c1c3682f016ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=88080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:26:33.964595 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.fernet_utils [None req-b9724056-6775-4775-90c8-8457947cefe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:26:33.973174 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 486/966] 10.222.0.18 () {58 vars in 1024 bytes} [Sat Sep 24 19:26:33 2022] POST /identity/v3/auth/tokens => generated 2798 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:26:34.310322 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d086bf-cfd8-4a2f-bfd5-79264c98f35f None None] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:26:34.315588 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=51 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:26:34.322056 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d086bf-cfd8-4a2f-bfd5-79264c98f35f None None] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:26:34.325638 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf921fbb-28c3-4d47-b1c9-9d27ac45b08e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ef291c173794b49ade9469a5ef72e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dfa5c2c17244006bdd629ec81553f1a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:26:34.326293 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf921fbb-28c3-4d47-b1c9-9d27ac45b08e service neutron] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:26:34.326572 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf921fbb-28c3-4d47-b1c9-9d27ac45b08e service neutron] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:26:34.326963 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf921fbb-28c3-4d47-b1c9-9d27ac45b08e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:26:34.336831 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf921fbb-28c3-4d47-b1c9-9d27ac45b08e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:26:34.338343 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf921fbb-28c3-4d47-b1c9-9d27ac45b08e service neutron] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:26:34.350655 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 481/967] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Sep 24 19:26:34 2022] GET /identity/v3/auth/tokens => generated 2798 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 24 19:26:38.930768 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fe1424-e640-41dc-9b8f-08e7c649b2be None None] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:26:38.931276 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fe1424-e640-41dc-9b8f-08e7c649b2be None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:26:38.931365 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fe1424-e640-41dc-9b8f-08e7c649b2be None None] PATH_INFO: `/` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:26:38.932736 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 487/968] 10.222.0.18 () {54 vars in 927 bytes} [Sat Sep 24 19:26:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:26:38.938173 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b647834-7941-4dfa-8a9b-60bc9fdd4a58 None None] REQUEST_METHOD: `POST` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:26:38.938613 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b647834-7941-4dfa-8a9b-60bc9fdd4a58 None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:26:38.938723 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b647834-7941-4dfa-8a9b-60bc9fdd4a58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:26:38.958208 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.auth.core [None req-9b647834-7941-4dfa-8a9b-60bc9fdd4a58 None None] MFA Rules not processed for user `3dbbb9909cec43ff99c1c3682f016ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=88081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:26:38.959371 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.fernet_utils [None req-9b647834-7941-4dfa-8a9b-60bc9fdd4a58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:26:38.967580 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 482/969] 10.222.0.18 () {58 vars in 1024 bytes} [Sat Sep 24 19:26:38 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 19:26:39.307664 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fe1424-e640-41dc-9b8f-08e7c649b2be None None] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:26:39.319090 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fe1424-e640-41dc-9b8f-08e7c649b2be None None] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:26:39.323326 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b703babc-9c2f-4331-8c66-ff2145460c04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ef291c173794b49ade9469a5ef72e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dfa5c2c17244006bdd629ec81553f1a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:26:39.323937 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b703babc-9c2f-4331-8c66-ff2145460c04 service neutron] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:26:39.324212 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b703babc-9c2f-4331-8c66-ff2145460c04 service neutron] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:26:39.324477 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b703babc-9c2f-4331-8c66-ff2145460c04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:26:39.334050 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b703babc-9c2f-4331-8c66-ff2145460c04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:26:39.335472 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b703babc-9c2f-4331-8c66-ff2145460c04 service neutron] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:26:39.344847 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 488/970] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Sep 24 19:26:39 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:26:44.959254 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a31a90e-3fc4-4f84-aaae-22cd31caf88c None None] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:26:44.960087 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a31a90e-3fc4-4f84-aaae-22cd31caf88c None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:26:44.960540 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a31a90e-3fc4-4f84-aaae-22cd31caf88c None None] PATH_INFO: `/` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:26:44.962588 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 483/971] 10.222.0.18 () {54 vars in 921 bytes} [Sat Sep 24 19:26:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:26:44.970342 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f681538b-b3c4-40a2-852b-322b73ff2f94 None None] REQUEST_METHOD: `POST` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:26:44.971132 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f681538b-b3c4-40a2-852b-322b73ff2f94 None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:26:44.971600 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f681538b-b3c4-40a2-852b-322b73ff2f94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:26:45.050891 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.auth.core [None req-f681538b-b3c4-40a2-852b-322b73ff2f94 None None] MFA Rules not processed for user `f2dfc6ff4e9b4d30b28d39d678b19896`. Rule list: `[]` (Enabled: `True`). {{(pid=88080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:26:45.052397 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.fernet_utils [None req-f681538b-b3c4-40a2-852b-322b73ff2f94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:26:45.143546 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 489/972] 10.222.0.18 () {58 vars in 1018 bytes} [Sat Sep 24 19:26:44 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:26:48.953107 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=8 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:26:49.917020 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89518c5-c983-43fb-bf71-14dddf5ffef0 None None] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:26:49.917316 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89518c5-c983-43fb-bf71-14dddf5ffef0 None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:26:49.917583 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89518c5-c983-43fb-bf71-14dddf5ffef0 None None] PATH_INFO: `/` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:26:49.919179 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 484/973] 10.222.0.18 () {54 vars in 921 bytes} [Sat Sep 24 19:26:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:26:49.924745 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984847b7-c2dc-4f2c-8d6b-b2484c7b4823 None None] REQUEST_METHOD: `POST` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:26:49.925293 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984847b7-c2dc-4f2c-8d6b-b2484c7b4823 None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:26:49.925293 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984847b7-c2dc-4f2c-8d6b-b2484c7b4823 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:26:49.945893 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.auth.core [None req-984847b7-c2dc-4f2c-8d6b-b2484c7b4823 None None] MFA Rules not processed for user `f2dfc6ff4e9b4d30b28d39d678b19896`. Rule list: `[]` (Enabled: `True`). {{(pid=88080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:26:49.947337 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.fernet_utils [None req-984847b7-c2dc-4f2c-8d6b-b2484c7b4823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:26:49.956298 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 490/974] 10.222.0.18 () {58 vars in 1018 bytes} [Sat Sep 24 19:26:49 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:26:51.423539 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d42512-6c42-4f53-ab19-71e6c15d7df1 None None] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:26:51.424078 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d42512-6c42-4f53-ab19-71e6c15d7df1 None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:26:51.424078 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d42512-6c42-4f53-ab19-71e6c15d7df1 None None] PATH_INFO: `/` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:26:51.425376 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 485/975] 10.222.0.18 () {54 vars in 921 bytes} [Sat Sep 24 19:26:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:26:51.431271 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a07131-68bd-4e56-9a94-d72f70de7747 None None] REQUEST_METHOD: `POST` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:26:51.431883 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a07131-68bd-4e56-9a94-d72f70de7747 None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:26:51.432008 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a07131-68bd-4e56-9a94-d72f70de7747 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:26:51.453622 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.auth.core [None req-62a07131-68bd-4e56-9a94-d72f70de7747 None None] MFA Rules not processed for user `f2dfc6ff4e9b4d30b28d39d678b19896`. Rule list: `[]` (Enabled: `True`). {{(pid=88080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:26:51.454928 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.fernet_utils [None req-62a07131-68bd-4e56-9a94-d72f70de7747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:26:51.463421 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 491/976] 10.222.0.18 () {58 vars in 1018 bytes} [Sat Sep 24 19:26:51 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:26:55.845567 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b784c2e2-4d8d-422d-9578-13907359f784 None None] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:26:55.846128 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b784c2e2-4d8d-422d-9578-13907359f784 None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:26:55.846128 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b784c2e2-4d8d-422d-9578-13907359f784 None None] PATH_INFO: `/` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:26:55.847550 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 486/977] 10.222.0.18 () {54 vars in 927 bytes} [Sat Sep 24 19:26:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:26:55.852978 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea9222c-f90a-4045-b89b-5e9a944b5b9a None None] REQUEST_METHOD: `POST` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:26:55.853417 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea9222c-f90a-4045-b89b-5e9a944b5b9a None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:26:55.853509 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea9222c-f90a-4045-b89b-5e9a944b5b9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:26:55.860765 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=69 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:26:55.875836 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.auth.core [None req-4ea9222c-f90a-4045-b89b-5e9a944b5b9a None None] MFA Rules not processed for user `3dbbb9909cec43ff99c1c3682f016ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=88080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:26:55.877060 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.fernet_utils [None req-4ea9222c-f90a-4045-b89b-5e9a944b5b9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:26:55.885709 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 492/978] 10.222.0.18 () {58 vars in 1024 bytes} [Sat Sep 24 19:26:55 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:26:56.236270 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bcb11a-31f5-4998-a5bf-6154be3abc05 None None] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:26:56.236668 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bcb11a-31f5-4998-a5bf-6154be3abc05 None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:26:56.237023 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bcb11a-31f5-4998-a5bf-6154be3abc05 None None] PATH_INFO: `/` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:26:56.238847 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 487/979] 10.222.0.18 () {54 vars in 961 bytes} [Sat Sep 24 19:26:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:26:56.246508 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62488ef2-c93d-4a92-8e69-22f2ea30c41a None None] REQUEST_METHOD: `POST` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:26:56.246882 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62488ef2-c93d-4a92-8e69-22f2ea30c41a None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:26:56.247397 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62488ef2-c93d-4a92-8e69-22f2ea30c41a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:26:56.298126 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.auth.core [None req-62488ef2-c93d-4a92-8e69-22f2ea30c41a None None] MFA Rules not processed for user `0ab73abe1c6e4b25a17281f4cd8e97e9`. Rule list: `[]` (Enabled: `True`). {{(pid=88080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:26:56.300104 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.fernet_utils [None req-62488ef2-c93d-4a92-8e69-22f2ea30c41a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:26:56.380549 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 493/980] 10.222.0.18 () {58 vars in 1058 bytes} [Sat Sep 24 19:26:56 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 19:26:56.388931 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bcb11a-31f5-4998-a5bf-6154be3abc05 None None] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:26:56.405350 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bcb11a-31f5-4998-a5bf-6154be3abc05 None None] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:26:56.411225 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ad3bba-3a8a-40c4-a6e8-197d98acdd1e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ab73abe1c6e4b25a17281f4cd8e97e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dfa5c2c17244006bdd629ec81553f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:26:56.411847 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ad3bba-3a8a-40c4-a6e8-197d98acdd1e service nova] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:26:56.412125 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ad3bba-3a8a-40c4-a6e8-197d98acdd1e service nova] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:26:56.412941 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ad3bba-3a8a-40c4-a6e8-197d98acdd1e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:26:56.424298 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ad3bba-3a8a-40c4-a6e8-197d98acdd1e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:26:56.426156 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ad3bba-3a8a-40c4-a6e8-197d98acdd1e service nova] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:26:56.437477 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 488/981] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Sep 24 19:26:56 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 24 19:26:59.106885 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864ab49d-b233-4e19-badc-e918a711a277 None None] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:26:59.107465 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864ab49d-b233-4e19-badc-e918a711a277 None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:26:59.107559 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864ab49d-b233-4e19-badc-e918a711a277 None None] PATH_INFO: `/` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:26:59.109250 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 494/982] 10.222.0.18 () {54 vars in 927 bytes} [Sat Sep 24 19:26:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:26:59.115436 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297e51ba-836d-49d0-a39f-3326db4e8ead None None] REQUEST_METHOD: `POST` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:26:59.116017 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297e51ba-836d-49d0-a39f-3326db4e8ead None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:26:59.116017 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297e51ba-836d-49d0-a39f-3326db4e8ead None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:26:59.136620 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.auth.core [None req-297e51ba-836d-49d0-a39f-3326db4e8ead None None] MFA Rules not processed for user `3dbbb9909cec43ff99c1c3682f016ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=88081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:26:59.137786 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.fernet_utils [None req-297e51ba-836d-49d0-a39f-3326db4e8ead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:26:59.145857 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 489/983] 10.222.0.18 () {58 vars in 1024 bytes} [Sat Sep 24 19:26:59 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:26:59.500053 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864ab49d-b233-4e19-badc-e918a711a277 None None] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:26:59.514831 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864ab49d-b233-4e19-badc-e918a711a277 None None] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:26:59.520499 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2788c9-6cca-4906-9611-e290a2140466 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ab73abe1c6e4b25a17281f4cd8e97e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dfa5c2c17244006bdd629ec81553f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:26:59.521463 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2788c9-6cca-4906-9611-e290a2140466 service nova] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:26:59.522031 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2788c9-6cca-4906-9611-e290a2140466 service nova] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:26:59.522509 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2788c9-6cca-4906-9611-e290a2140466 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:26:59.532006 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2788c9-6cca-4906-9611-e290a2140466 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:26:59.533814 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2788c9-6cca-4906-9611-e290a2140466 service nova] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:26:59.545789 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 495/984] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Sep 24 19:26:59 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:27:02.358382 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd8213d-15a6-4f76-b4eb-512793336481 None None] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:27:02.358941 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd8213d-15a6-4f76-b4eb-512793336481 None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:27:02.358941 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd8213d-15a6-4f76-b4eb-512793336481 None None] PATH_INFO: `/` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:27:02.360276 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 490/985] 10.222.0.18 () {54 vars in 927 bytes} [Sat Sep 24 19:27:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:27:02.365921 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cf84cf-2191-433e-a7dc-16216668b6b4 None None] REQUEST_METHOD: `POST` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:27:02.366802 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cf84cf-2191-433e-a7dc-16216668b6b4 None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:27:02.367142 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cf84cf-2191-433e-a7dc-16216668b6b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:27:02.390839 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.auth.core [None req-f6cf84cf-2191-433e-a7dc-16216668b6b4 None None] MFA Rules not processed for user `3dbbb9909cec43ff99c1c3682f016ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=88080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:27:02.392785 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.fernet_utils [None req-f6cf84cf-2191-433e-a7dc-16216668b6b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:27:02.401646 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 496/986] 10.222.0.18 () {58 vars in 1024 bytes} [Sat Sep 24 19:27:02 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:27:02.748536 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a93d93-d4a2-4d23-98c1-ffa9bdc97c3e None None] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:27:02.749068 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a93d93-d4a2-4d23-98c1-ffa9bdc97c3e None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:27:02.749499 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a93d93-d4a2-4d23-98c1-ffa9bdc97c3e None None] PATH_INFO: `/` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:27:02.752505 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 491/987] 10.222.0.18 () {54 vars in 961 bytes} [Sat Sep 24 19:27:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:27:02.759793 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aff93a6-3e9f-44ff-9d37-b08ba83ec702 None None] REQUEST_METHOD: `POST` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:27:02.760077 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aff93a6-3e9f-44ff-9d37-b08ba83ec702 None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:27:02.760354 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aff93a6-3e9f-44ff-9d37-b08ba83ec702 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:27:02.792230 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.auth.core [None req-1aff93a6-3e9f-44ff-9d37-b08ba83ec702 None None] MFA Rules not processed for user `0ab73abe1c6e4b25a17281f4cd8e97e9`. Rule list: `[]` (Enabled: `True`). {{(pid=88080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:27:02.794305 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.fernet_utils [None req-1aff93a6-3e9f-44ff-9d37-b08ba83ec702 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:27:02.810842 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 497/988] 10.222.0.18 () {58 vars in 1058 bytes} [Sat Sep 24 19:27:02 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:27:02.821790 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a93d93-d4a2-4d23-98c1-ffa9bdc97c3e None None] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:27:02.840667 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a93d93-d4a2-4d23-98c1-ffa9bdc97c3e None None] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:27:02.846732 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e15e01c-841d-44bf-88f9-3a1103788cb7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ab73abe1c6e4b25a17281f4cd8e97e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dfa5c2c17244006bdd629ec81553f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:27:02.850011 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e15e01c-841d-44bf-88f9-3a1103788cb7 service nova] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:27:02.850011 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e15e01c-841d-44bf-88f9-3a1103788cb7 service nova] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:27:02.850011 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e15e01c-841d-44bf-88f9-3a1103788cb7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:27:02.858178 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e15e01c-841d-44bf-88f9-3a1103788cb7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:27:02.859795 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e15e01c-841d-44bf-88f9-3a1103788cb7 service nova] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:27:02.874584 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 492/989] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Sep 24 19:27:02 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:27:05.467295 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728cad12-9c70-4884-96a2-e4fbedba5bff None None] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:27:05.468301 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728cad12-9c70-4884-96a2-e4fbedba5bff None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:27:05.468779 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728cad12-9c70-4884-96a2-e4fbedba5bff None None] PATH_INFO: `/` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:27:05.470385 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 498/990] 10.222.0.18 () {54 vars in 927 bytes} [Sat Sep 24 19:27:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:27:05.475928 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d87145-8de3-4f7e-9b47-c60dd14aea2e None None] REQUEST_METHOD: `POST` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:27:05.476701 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d87145-8de3-4f7e-9b47-c60dd14aea2e None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:27:05.477672 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d87145-8de3-4f7e-9b47-c60dd14aea2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:27:05.505180 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.auth.core [None req-27d87145-8de3-4f7e-9b47-c60dd14aea2e None None] MFA Rules not processed for user `3dbbb9909cec43ff99c1c3682f016ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=88081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:27:05.507007 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.fernet_utils [None req-27d87145-8de3-4f7e-9b47-c60dd14aea2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:27:05.521856 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 493/991] 10.222.0.18 () {58 vars in 1024 bytes} [Sat Sep 24 19:27:05 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 19:27:05.891537 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728cad12-9c70-4884-96a2-e4fbedba5bff None None] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:27:05.907798 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728cad12-9c70-4884-96a2-e4fbedba5bff None None] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:27:05.917082 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1129f2-1d88-4daf-a6e3-766b7b1ccfbe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ab73abe1c6e4b25a17281f4cd8e97e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dfa5c2c17244006bdd629ec81553f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:27:05.918438 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1129f2-1d88-4daf-a6e3-766b7b1ccfbe service nova] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:27:05.918935 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1129f2-1d88-4daf-a6e3-766b7b1ccfbe service nova] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:27:05.919628 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1129f2-1d88-4daf-a6e3-766b7b1ccfbe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:27:05.936218 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1129f2-1d88-4daf-a6e3-766b7b1ccfbe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:27:05.938688 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1129f2-1d88-4daf-a6e3-766b7b1ccfbe service nova] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:27:05.951700 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 499/992] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Sep 24 19:27:05 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:27:06.585876 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c586bbe3-36ad-4b19-9902-59daee83e448 None None] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:27:06.587146 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c586bbe3-36ad-4b19-9902-59daee83e448 None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:27:06.587146 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c586bbe3-36ad-4b19-9902-59daee83e448 None None] PATH_INFO: `/` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:27:06.588514 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 494/993] 10.222.0.18 () {54 vars in 927 bytes} [Sat Sep 24 19:27:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:27:06.596233 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbc359c-93ec-4787-801e-31cbef42f2a0 None None] REQUEST_METHOD: `POST` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:27:06.596975 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbc359c-93ec-4787-801e-31cbef42f2a0 None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:27:06.596975 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbc359c-93ec-4787-801e-31cbef42f2a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:27:06.620182 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.auth.core [None req-2fbc359c-93ec-4787-801e-31cbef42f2a0 None None] MFA Rules not processed for user `3dbbb9909cec43ff99c1c3682f016ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=88080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:27:06.621594 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.fernet_utils [None req-2fbc359c-93ec-4787-801e-31cbef42f2a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:27:06.630554 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 500/994] 10.222.0.18 () {58 vars in 1024 bytes} [Sat Sep 24 19:27:06 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:27:07.045441 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7e8cf1-6761-416b-b7c7-47041ce4c4ca None None] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:27:07.045716 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7e8cf1-6761-416b-b7c7-47041ce4c4ca None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:27:07.046023 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7e8cf1-6761-416b-b7c7-47041ce4c4ca None None] PATH_INFO: `/` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:27:07.047550 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 495/995] 10.222.0.18 () {54 vars in 963 bytes} [Sat Sep 24 19:27:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:27:07.053676 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fec261-63b0-46e0-bbb7-8a3b8b9b8377 None None] REQUEST_METHOD: `POST` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:27:07.053987 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fec261-63b0-46e0-bbb7-8a3b8b9b8377 None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:27:07.054260 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fec261-63b0-46e0-bbb7-8a3b8b9b8377 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:27:07.098443 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.auth.core [None req-a2fec261-63b0-46e0-bbb7-8a3b8b9b8377 None None] MFA Rules not processed for user `cd2db56b901e4fb08a0ec849cc9136f9`. Rule list: `[]` (Enabled: `True`). {{(pid=88080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:27:07.099721 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.fernet_utils [None req-a2fec261-63b0-46e0-bbb7-8a3b8b9b8377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:27:07.170015 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 501/996] 10.222.0.18 () {58 vars in 1060 bytes} [Sat Sep 24 19:27:07 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:27:07.177742 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7e8cf1-6761-416b-b7c7-47041ce4c4ca None None] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:27:07.190136 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7e8cf1-6761-416b-b7c7-47041ce4c4ca None None] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:27:07.193887 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5c769a-4e0e-4a1f-8a60-bf4284202204 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd2db56b901e4fb08a0ec849cc9136f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dfa5c2c17244006bdd629ec81553f1a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:27:07.194495 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5c769a-4e0e-4a1f-8a60-bf4284202204 service cinder] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:27:07.194821 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5c769a-4e0e-4a1f-8a60-bf4284202204 service cinder] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:27:07.195219 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5c769a-4e0e-4a1f-8a60-bf4284202204 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:27:07.205800 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5c769a-4e0e-4a1f-8a60-bf4284202204 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:27:07.207239 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5c769a-4e0e-4a1f-8a60-bf4284202204 service cinder] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:27:07.217306 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 496/997] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Sep 24 19:27:07 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 24 19:27:08.920612 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d6b962-5753-4774-9626-3b914b66aa87 None None] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:27:08.921176 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d6b962-5753-4774-9626-3b914b66aa87 None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:27:08.921176 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d6b962-5753-4774-9626-3b914b66aa87 None None] PATH_INFO: `/` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:27:08.922612 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 502/998] 10.222.0.18 () {54 vars in 927 bytes} [Sat Sep 24 19:27:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:27:08.928088 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a7f749-5d8a-49a7-9156-382852d761ba None None] REQUEST_METHOD: `POST` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:27:08.928578 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a7f749-5d8a-49a7-9156-382852d761ba None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:27:08.928715 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a7f749-5d8a-49a7-9156-382852d761ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:27:08.950339 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.auth.core [None req-58a7f749-5d8a-49a7-9156-382852d761ba None None] MFA Rules not processed for user `3dbbb9909cec43ff99c1c3682f016ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=88081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:27:08.951944 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.fernet_utils [None req-58a7f749-5d8a-49a7-9156-382852d761ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:27:08.960043 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 497/999] 10.222.0.18 () {58 vars in 1024 bytes} [Sat Sep 24 19:27:08 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 19:27:09.310140 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d6b962-5753-4774-9626-3b914b66aa87 None None] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:27:09.328954 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d6b962-5753-4774-9626-3b914b66aa87 None None] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:27:09.335412 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a96b50-87f8-4f6e-936b-d9ca9641bcf4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ab73abe1c6e4b25a17281f4cd8e97e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dfa5c2c17244006bdd629ec81553f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:27:09.336027 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a96b50-87f8-4f6e-936b-d9ca9641bcf4 service nova] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:27:09.336337 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a96b50-87f8-4f6e-936b-d9ca9641bcf4 service nova] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:27:09.336642 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a96b50-87f8-4f6e-936b-d9ca9641bcf4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:27:09.348300 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a96b50-87f8-4f6e-936b-d9ca9641bcf4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:27:09.350641 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a96b50-87f8-4f6e-936b-d9ca9641bcf4 service nova] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:27:09.356684 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:27:09.365407 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 503/1000] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Sep 24 19:27:09 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 24 19:27:11.889920 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68187eb-3563-4613-ad04-448f6e891a3f None None] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:27:11.890467 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68187eb-3563-4613-ad04-448f6e891a3f None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:27:11.890700 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68187eb-3563-4613-ad04-448f6e891a3f None None] PATH_INFO: `/` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:27:11.892133 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 498/1001] 10.222.0.18 () {54 vars in 927 bytes} [Sat Sep 24 19:27:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:27:11.897573 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2d458a-2765-4c0e-b66b-71e03abdaa93 None None] REQUEST_METHOD: `POST` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:27:11.898067 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2d458a-2765-4c0e-b66b-71e03abdaa93 None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:27:11.898340 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2d458a-2765-4c0e-b66b-71e03abdaa93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:27:11.918480 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.auth.core [None req-3b2d458a-2765-4c0e-b66b-71e03abdaa93 None None] MFA Rules not processed for user `3dbbb9909cec43ff99c1c3682f016ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=88080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:27:11.919706 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.fernet_utils [None req-3b2d458a-2765-4c0e-b66b-71e03abdaa93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:27:11.927693 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 504/1002] 10.222.0.18 () {58 vars in 1024 bytes} [Sat Sep 24 19:27:11 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:27:12.271073 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68187eb-3563-4613-ad04-448f6e891a3f None None] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:27:12.286688 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68187eb-3563-4613-ad04-448f6e891a3f None None] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:27:12.292046 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ecee92-ce26-4cdf-bcc8-67c6674e06a4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ab73abe1c6e4b25a17281f4cd8e97e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dfa5c2c17244006bdd629ec81553f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:27:12.292779 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ecee92-ce26-4cdf-bcc8-67c6674e06a4 service nova] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:27:12.293309 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ecee92-ce26-4cdf-bcc8-67c6674e06a4 service nova] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:27:12.293733 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ecee92-ce26-4cdf-bcc8-67c6674e06a4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:27:12.302757 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ecee92-ce26-4cdf-bcc8-67c6674e06a4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:27:12.304470 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ecee92-ce26-4cdf-bcc8-67c6674e06a4 service nova] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:27:12.315362 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 499/1003] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Sep 24 19:27:12 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:27:14.818723 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea96151-0ccc-4347-98d0-542f67be6f71 None None] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:27:14.819278 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea96151-0ccc-4347-98d0-542f67be6f71 None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:27:14.819278 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea96151-0ccc-4347-98d0-542f67be6f71 None None] PATH_INFO: `/` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:27:14.820601 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 505/1004] 10.222.0.18 () {54 vars in 927 bytes} [Sat Sep 24 19:27:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:27:14.826533 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05caebdf-583f-4865-bdc0-9c68db3d84bf None None] REQUEST_METHOD: `POST` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:27:14.826963 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05caebdf-583f-4865-bdc0-9c68db3d84bf None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:27:14.827089 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05caebdf-583f-4865-bdc0-9c68db3d84bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:27:14.846770 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.auth.core [None req-05caebdf-583f-4865-bdc0-9c68db3d84bf None None] MFA Rules not processed for user `3dbbb9909cec43ff99c1c3682f016ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=88081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:27:14.847975 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.fernet_utils [None req-05caebdf-583f-4865-bdc0-9c68db3d84bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:27:14.856947 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 500/1005] 10.222.0.18 () {58 vars in 1024 bytes} [Sat Sep 24 19:27:14 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:27:15.203709 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea96151-0ccc-4347-98d0-542f67be6f71 None None] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:27:15.217805 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea96151-0ccc-4347-98d0-542f67be6f71 None None] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:27:15.227315 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ae402e-3c47-4dce-8b99-d65ae3d3dd05 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ab73abe1c6e4b25a17281f4cd8e97e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dfa5c2c17244006bdd629ec81553f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:27:15.228167 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ae402e-3c47-4dce-8b99-d65ae3d3dd05 service nova] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:27:15.228609 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ae402e-3c47-4dce-8b99-d65ae3d3dd05 service nova] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:27:15.229031 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ae402e-3c47-4dce-8b99-d65ae3d3dd05 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:27:15.239039 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ae402e-3c47-4dce-8b99-d65ae3d3dd05 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:27:15.240871 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ae402e-3c47-4dce-8b99-d65ae3d3dd05 service nova] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:27:15.252297 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 506/1006] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Sep 24 19:27:15 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:27:18.138314 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259af7ff-b500-4586-81f2-6de3c6690537 None None] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:27:18.139652 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259af7ff-b500-4586-81f2-6de3c6690537 None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:27:18.139652 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259af7ff-b500-4586-81f2-6de3c6690537 None None] PATH_INFO: `/` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:27:18.140273 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 501/1007] 10.222.0.18 () {54 vars in 927 bytes} [Sat Sep 24 19:27:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:27:18.146321 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61153010-4490-4894-a451-32fc545b8acb None None] REQUEST_METHOD: `POST` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:27:18.147023 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61153010-4490-4894-a451-32fc545b8acb None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:27:18.147023 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61153010-4490-4894-a451-32fc545b8acb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:27:18.170523 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.auth.core [None req-61153010-4490-4894-a451-32fc545b8acb None None] MFA Rules not processed for user `3dbbb9909cec43ff99c1c3682f016ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=88080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:27:18.171748 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.fernet_utils [None req-61153010-4490-4894-a451-32fc545b8acb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:27:18.181956 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 507/1008] 10.222.0.18 () {58 vars in 1024 bytes} [Sat Sep 24 19:27:18 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:27:18.535720 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259af7ff-b500-4586-81f2-6de3c6690537 None None] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:27:18.550606 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259af7ff-b500-4586-81f2-6de3c6690537 None None] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:27:18.556334 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206db20e-41f6-45f0-b205-faa5b98c06dc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ab73abe1c6e4b25a17281f4cd8e97e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dfa5c2c17244006bdd629ec81553f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:27:18.556878 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206db20e-41f6-45f0-b205-faa5b98c06dc service nova] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:27:18.557102 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206db20e-41f6-45f0-b205-faa5b98c06dc service nova] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:27:18.557374 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206db20e-41f6-45f0-b205-faa5b98c06dc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:27:18.566075 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206db20e-41f6-45f0-b205-faa5b98c06dc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:27:18.567643 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206db20e-41f6-45f0-b205-faa5b98c06dc service nova] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:27:18.579376 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 502/1009] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Sep 24 19:27:18 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:27:21.597815 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c76c65-2eb0-45e1-97eb-6a5e188a0c75 None None] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:27:21.598461 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c76c65-2eb0-45e1-97eb-6a5e188a0c75 None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:27:21.598461 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c76c65-2eb0-45e1-97eb-6a5e188a0c75 None None] PATH_INFO: `/` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:27:21.599711 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 508/1010] 10.222.0.18 () {54 vars in 927 bytes} [Sat Sep 24 19:27:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:27:21.605229 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e9e937-6d0d-431b-9564-7f816d2ceb18 None None] REQUEST_METHOD: `POST` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:27:21.605716 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e9e937-6d0d-431b-9564-7f816d2ceb18 None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:27:21.605815 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e9e937-6d0d-431b-9564-7f816d2ceb18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:27:21.613044 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=43 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:27:21.626910 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.auth.core [None req-44e9e937-6d0d-431b-9564-7f816d2ceb18 None None] MFA Rules not processed for user `3dbbb9909cec43ff99c1c3682f016ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=88081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:27:21.628196 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.fernet_utils [None req-44e9e937-6d0d-431b-9564-7f816d2ceb18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:27:21.637102 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 503/1011] 10.222.0.18 () {58 vars in 1024 bytes} [Sat Sep 24 19:27:21 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:27:21.993348 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c76c65-2eb0-45e1-97eb-6a5e188a0c75 None None] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:27:22.007240 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c76c65-2eb0-45e1-97eb-6a5e188a0c75 None None] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:27:22.012129 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb6b0e7-741f-49c6-9f4b-2f60d3991f31 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ab73abe1c6e4b25a17281f4cd8e97e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dfa5c2c17244006bdd629ec81553f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:27:22.012732 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb6b0e7-741f-49c6-9f4b-2f60d3991f31 service nova] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:27:22.012999 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb6b0e7-741f-49c6-9f4b-2f60d3991f31 service nova] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:27:22.013263 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb6b0e7-741f-49c6-9f4b-2f60d3991f31 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:27:22.022210 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb6b0e7-741f-49c6-9f4b-2f60d3991f31 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:27:22.023827 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb6b0e7-741f-49c6-9f4b-2f60d3991f31 service nova] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:27:22.033995 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 509/1012] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Sep 24 19:27:21 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:27:23.693525 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fc337a-d615-4b00-85b1-32672c1bdb61 None None] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:27:23.694165 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fc337a-d615-4b00-85b1-32672c1bdb61 None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:27:23.694165 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fc337a-d615-4b00-85b1-32672c1bdb61 None None] PATH_INFO: `/` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:27:23.695496 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 504/1013] 10.222.0.18 () {54 vars in 927 bytes} [Sat Sep 24 19:27:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:27:23.701759 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00650aa0-8432-49fb-ab95-6e889a6f87fc None None] REQUEST_METHOD: `POST` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:27:23.702382 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00650aa0-8432-49fb-ab95-6e889a6f87fc None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:27:23.702382 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00650aa0-8432-49fb-ab95-6e889a6f87fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:27:23.722874 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.auth.core [None req-00650aa0-8432-49fb-ab95-6e889a6f87fc None None] MFA Rules not processed for user `3dbbb9909cec43ff99c1c3682f016ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=88080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:27:23.724963 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.fernet_utils [None req-00650aa0-8432-49fb-ab95-6e889a6f87fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:27:23.737246 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 510/1014] 10.222.0.18 () {58 vars in 1024 bytes} [Sat Sep 24 19:27:23 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:27:24.097104 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23ede42-3c8e-4a44-95fb-d9c1f9ac0e9b None None] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:27:24.097381 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23ede42-3c8e-4a44-95fb-d9c1f9ac0e9b None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:27:24.097657 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23ede42-3c8e-4a44-95fb-d9c1f9ac0e9b None None] PATH_INFO: `/` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:27:24.099039 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 505/1015] 10.222.0.18 () {54 vars in 962 bytes} [Sat Sep 24 19:27:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:27:24.105001 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3d1fe5-20ca-4b13-9f4f-b36e4bda71e9 None None] REQUEST_METHOD: `POST` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:27:24.105282 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3d1fe5-20ca-4b13-9f4f-b36e4bda71e9 None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:27:24.105554 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3d1fe5-20ca-4b13-9f4f-b36e4bda71e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:27:24.144958 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.auth.core [None req-5d3d1fe5-20ca-4b13-9f4f-b36e4bda71e9 None None] MFA Rules not processed for user `135ee6a2c657412ba6d65a51403ef4d6`. Rule list: `[]` (Enabled: `True`). {{(pid=88080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:27:24.146189 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.fernet_utils [None req-5d3d1fe5-20ca-4b13-9f4f-b36e4bda71e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:27:24.207104 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 511/1016] 10.222.0.18 () {58 vars in 1059 bytes} [Sat Sep 24 19:27:24 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:27:24.215335 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23ede42-3c8e-4a44-95fb-d9c1f9ac0e9b None None] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:27:24.226240 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23ede42-3c8e-4a44-95fb-d9c1f9ac0e9b None None] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:27:24.230849 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2413514-ba9f-4d97-9ecb-e7d59e48d1fb service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '135ee6a2c657412ba6d65a51403ef4d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dfa5c2c17244006bdd629ec81553f1a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:27:24.231471 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2413514-ba9f-4d97-9ecb-e7d59e48d1fb service glance] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:27:24.231941 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2413514-ba9f-4d97-9ecb-e7d59e48d1fb service glance] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:27:24.232219 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2413514-ba9f-4d97-9ecb-e7d59e48d1fb service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:27:24.241893 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2413514-ba9f-4d97-9ecb-e7d59e48d1fb service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:27:24.243334 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2413514-ba9f-4d97-9ecb-e7d59e48d1fb service glance] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:27:24.253475 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 506/1017] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Sep 24 19:27:24 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 24 19:27:24.517276 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09534b05-a71f-40dd-aa5a-acc9f59833b6 None None] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:27:24.517544 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09534b05-a71f-40dd-aa5a-acc9f59833b6 None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:27:24.517901 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09534b05-a71f-40dd-aa5a-acc9f59833b6 None None] PATH_INFO: `/` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:27:24.519196 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 512/1018] 10.222.0.18 () {54 vars in 927 bytes} [Sat Sep 24 19:27:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:27:24.525451 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2874089d-38f9-45ae-a9f3-de4074783854 None None] REQUEST_METHOD: `POST` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:27:24.525755 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2874089d-38f9-45ae-a9f3-de4074783854 None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:27:24.526078 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2874089d-38f9-45ae-a9f3-de4074783854 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:27:24.545251 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.auth.core [None req-2874089d-38f9-45ae-a9f3-de4074783854 None None] MFA Rules not processed for user `3dbbb9909cec43ff99c1c3682f016ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=88081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:27:24.546479 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.fernet_utils [None req-2874089d-38f9-45ae-a9f3-de4074783854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:27:24.555244 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 507/1019] 10.222.0.18 () {58 vars in 1024 bytes} [Sat Sep 24 19:27:24 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:27:24.899124 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09534b05-a71f-40dd-aa5a-acc9f59833b6 None None] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:27:24.913142 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09534b05-a71f-40dd-aa5a-acc9f59833b6 None None] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:27:24.918054 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af626f0-21d0-41d0-8799-04b557d1fc7e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ab73abe1c6e4b25a17281f4cd8e97e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dfa5c2c17244006bdd629ec81553f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:27:24.918643 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af626f0-21d0-41d0-8799-04b557d1fc7e service nova] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:27:24.918913 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af626f0-21d0-41d0-8799-04b557d1fc7e service nova] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:27:24.919178 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af626f0-21d0-41d0-8799-04b557d1fc7e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:27:24.927677 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af626f0-21d0-41d0-8799-04b557d1fc7e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:27:24.929253 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af626f0-21d0-41d0-8799-04b557d1fc7e service nova] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:27:24.942286 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 513/1020] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Sep 24 19:27:24 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:27:27.476489 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ce1ca4-e9e8-4e62-8140-a12a86886983 None None] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:27:27.477189 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ce1ca4-e9e8-4e62-8140-a12a86886983 None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:27:27.477189 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ce1ca4-e9e8-4e62-8140-a12a86886983 None None] PATH_INFO: `/` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:27:27.478938 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 508/1021] 10.222.0.18 () {54 vars in 927 bytes} [Sat Sep 24 19:27:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:27:27.484231 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aeb2a3-60a5-435d-8f93-3f35706f3dcb None None] REQUEST_METHOD: `POST` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:27:27.484776 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aeb2a3-60a5-435d-8f93-3f35706f3dcb None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:27:27.484776 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aeb2a3-60a5-435d-8f93-3f35706f3dcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:27:27.506128 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.auth.core [None req-63aeb2a3-60a5-435d-8f93-3f35706f3dcb None None] MFA Rules not processed for user `3dbbb9909cec43ff99c1c3682f016ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=88080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:27:27.507776 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.fernet_utils [None req-63aeb2a3-60a5-435d-8f93-3f35706f3dcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:27:27.516939 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 514/1022] 10.222.0.18 () {58 vars in 1024 bytes} [Sat Sep 24 19:27:27 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:27:27.877597 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ce1ca4-e9e8-4e62-8140-a12a86886983 None None] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:27:27.890976 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ce1ca4-e9e8-4e62-8140-a12a86886983 None None] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:27:27.898388 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41eefec-014a-4276-becb-4d9598d01920 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ab73abe1c6e4b25a17281f4cd8e97e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dfa5c2c17244006bdd629ec81553f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:27:27.899002 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41eefec-014a-4276-becb-4d9598d01920 service nova] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:27:27.899820 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41eefec-014a-4276-becb-4d9598d01920 service nova] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:27:27.900091 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41eefec-014a-4276-becb-4d9598d01920 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:27:27.909543 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41eefec-014a-4276-becb-4d9598d01920 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:27:27.911204 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41eefec-014a-4276-becb-4d9598d01920 service nova] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:27:27.922796 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 509/1023] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Sep 24 19:27:27 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:27:30.579732 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47be3bd9-0eff-4086-8653-21dcbe83ae07 None None] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:27:30.580368 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47be3bd9-0eff-4086-8653-21dcbe83ae07 None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:27:30.580368 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47be3bd9-0eff-4086-8653-21dcbe83ae07 None None] PATH_INFO: `/` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:27:30.583337 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 515/1024] 10.222.0.18 () {54 vars in 927 bytes} [Sat Sep 24 19:27:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:27:30.587505 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3ca605-09e4-4c53-9b5d-613fabf29ade None None] REQUEST_METHOD: `POST` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:27:30.588054 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3ca605-09e4-4c53-9b5d-613fabf29ade None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:27:30.588162 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3ca605-09e4-4c53-9b5d-613fabf29ade None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:27:30.608957 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.auth.core [None req-8f3ca605-09e4-4c53-9b5d-613fabf29ade None None] MFA Rules not processed for user `3dbbb9909cec43ff99c1c3682f016ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=88081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:27:30.614898 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.fernet_utils [None req-8f3ca605-09e4-4c53-9b5d-613fabf29ade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:27:30.625894 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 510/1025] 10.222.0.18 () {58 vars in 1024 bytes} [Sat Sep 24 19:27:30 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 19:27:30.970275 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47be3bd9-0eff-4086-8653-21dcbe83ae07 None None] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:27:30.984441 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47be3bd9-0eff-4086-8653-21dcbe83ae07 None None] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:27:30.989937 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7e1547-88a5-4e0c-b3e4-bcde1b2be9fc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ab73abe1c6e4b25a17281f4cd8e97e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dfa5c2c17244006bdd629ec81553f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:27:30.990785 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7e1547-88a5-4e0c-b3e4-bcde1b2be9fc service nova] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:27:30.991059 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7e1547-88a5-4e0c-b3e4-bcde1b2be9fc service nova] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:27:30.991323 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7e1547-88a5-4e0c-b3e4-bcde1b2be9fc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:27:31.000419 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7e1547-88a5-4e0c-b3e4-bcde1b2be9fc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:27:31.002018 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7e1547-88a5-4e0c-b3e4-bcde1b2be9fc service nova] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:27:31.012014 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 516/1026] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Sep 24 19:27:30 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:27:39.782010 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6293d74-86c7-400d-a87b-28ae865508ff None None] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:27:39.782579 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6293d74-86c7-400d-a87b-28ae865508ff None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:27:39.782579 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6293d74-86c7-400d-a87b-28ae865508ff None None] PATH_INFO: `/` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:27:39.783885 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 511/1027] 10.222.0.18 () {54 vars in 918 bytes} [Sat Sep 24 19:27:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:27:39.789014 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d47b4a-2462-4bd4-8685-578ee741ff25 None None] REQUEST_METHOD: `POST` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:27:39.789462 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d47b4a-2462-4bd4-8685-578ee741ff25 None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:27:39.789563 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d47b4a-2462-4bd4-8685-578ee741ff25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:27:39.797639 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=71 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:27:39.811941 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.auth.core [None req-a2d47b4a-2462-4bd4-8685-578ee741ff25 None None] MFA Rules not processed for user `f2dfc6ff4e9b4d30b28d39d678b19896`. Rule list: `[]` (Enabled: `True`). {{(pid=88080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:27:39.813139 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.fernet_utils [None req-a2d47b4a-2462-4bd4-8685-578ee741ff25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:27:39.821664 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 517/1028] 10.222.0.18 () {58 vars in 1015 bytes} [Sat Sep 24 19:27:39 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:27:39.836413 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212e8854-1cff-4b44-9b31-e96d7987022d None None] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:27:39.836689 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212e8854-1cff-4b44-9b31-e96d7987022d None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:27:39.836958 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212e8854-1cff-4b44-9b31-e96d7987022d None None] PATH_INFO: `/` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:27:39.838374 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 512/1029] 10.222.0.18 () {54 vars in 918 bytes} [Sat Sep 24 19:27:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:27:39.842989 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e02b32-e644-4efe-9773-d5e802789b04 None None] REQUEST_METHOD: `POST` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:27:39.843273 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e02b32-e644-4efe-9773-d5e802789b04 None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:27:39.843546 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e02b32-e644-4efe-9773-d5e802789b04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:27:39.864357 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.auth.core [None req-c6e02b32-e644-4efe-9773-d5e802789b04 None None] MFA Rules not processed for user `0ab73abe1c6e4b25a17281f4cd8e97e9`. Rule list: `[]` (Enabled: `True`). {{(pid=88080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:27:39.865563 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.fernet_utils [None req-c6e02b32-e644-4efe-9773-d5e802789b04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:27:39.875559 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 518/1030] 10.222.0.18 () {58 vars in 1015 bytes} [Sat Sep 24 19:27:39 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:27:40.603521 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=20 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:27:42.770446 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20227973-2ad5-4d23-953b-ff80a12b0b18 None None] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:27:42.771087 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20227973-2ad5-4d23-953b-ff80a12b0b18 None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:27:42.771087 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20227973-2ad5-4d23-953b-ff80a12b0b18 None None] PATH_INFO: `/` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:27:42.772335 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 513/1031] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 24 19:27:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:27:42.777882 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dd52be-689b-4897-a9ba-dbda652b45d6 None None] REQUEST_METHOD: `POST` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:27:42.778346 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dd52be-689b-4897-a9ba-dbda652b45d6 None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:27:42.778471 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dd52be-689b-4897-a9ba-dbda652b45d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:27:42.797913 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.auth.core [None req-90dd52be-689b-4897-a9ba-dbda652b45d6 None None] MFA Rules not processed for user `3dbbb9909cec43ff99c1c3682f016ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=88080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:27:42.799108 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.fernet_utils [None req-90dd52be-689b-4897-a9ba-dbda652b45d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:27:42.807236 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 519/1032] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 24 19:27:42 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:27:43.148256 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20227973-2ad5-4d23-953b-ff80a12b0b18 None None] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:27:43.163333 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20227973-2ad5-4d23-953b-ff80a12b0b18 None None] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:27:43.168338 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f1f420-bc56-449b-9d77-0214299b2633 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ab73abe1c6e4b25a17281f4cd8e97e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dfa5c2c17244006bdd629ec81553f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:27:43.169517 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f1f420-bc56-449b-9d77-0214299b2633 service nova] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:27:43.169797 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f1f420-bc56-449b-9d77-0214299b2633 service nova] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:27:43.170101 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f1f420-bc56-449b-9d77-0214299b2633 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:27:43.178719 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f1f420-bc56-449b-9d77-0214299b2633 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:27:43.180283 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f1f420-bc56-449b-9d77-0214299b2633 service nova] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:27:43.190523 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 514/1033] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Sep 24 19:27:43 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:27:44.913819 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbe0deb-0a7f-4887-8156-18f5ffdc80ec None None] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:27:44.914431 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbe0deb-0a7f-4887-8156-18f5ffdc80ec None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:27:44.914431 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbe0deb-0a7f-4887-8156-18f5ffdc80ec None None] PATH_INFO: `/` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:27:44.915752 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 520/1034] 127.0.0.1 () {54 vars in 901 bytes} [Sat Sep 24 19:27:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:27:44.920687 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eee5d8f-56b8-4841-93f9-8c9fab4ce69c None None] REQUEST_METHOD: `POST` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:27:44.921147 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eee5d8f-56b8-4841-93f9-8c9fab4ce69c None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:27:44.921271 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eee5d8f-56b8-4841-93f9-8c9fab4ce69c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:27:44.942110 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.auth.core [None req-3eee5d8f-56b8-4841-93f9-8c9fab4ce69c None None] MFA Rules not processed for user `3dbbb9909cec43ff99c1c3682f016ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=88081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:27:44.943312 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.fernet_utils [None req-3eee5d8f-56b8-4841-93f9-8c9fab4ce69c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:27:44.951614 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 515/1035] 127.0.0.1 () {58 vars in 998 bytes} [Sat Sep 24 19:27:44 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:27:45.159209 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbe0deb-0a7f-4887-8156-18f5ffdc80ec None None] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:27:45.172702 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbe0deb-0a7f-4887-8156-18f5ffdc80ec None None] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:27:45.177853 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215effd7-6e4f-4c35-bb1d-8c3465def651 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ab73abe1c6e4b25a17281f4cd8e97e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dfa5c2c17244006bdd629ec81553f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:27:45.178453 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215effd7-6e4f-4c35-bb1d-8c3465def651 service nova] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:27:45.178751 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215effd7-6e4f-4c35-bb1d-8c3465def651 service nova] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:27:45.179015 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215effd7-6e4f-4c35-bb1d-8c3465def651 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:27:45.187787 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215effd7-6e4f-4c35-bb1d-8c3465def651 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:27:45.189368 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215effd7-6e4f-4c35-bb1d-8c3465def651 service nova] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:27:45.199763 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 521/1036] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Sep 24 19:27:45 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:27:46.888840 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e7090c-830d-4de9-be18-85eb5a358cbf None None] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:27:46.889411 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e7090c-830d-4de9-be18-85eb5a358cbf None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:27:46.889411 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e7090c-830d-4de9-be18-85eb5a358cbf None None] PATH_INFO: `/` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:27:46.890786 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 516/1037] 127.0.0.1 () {54 vars in 901 bytes} [Sat Sep 24 19:27:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:27:46.895966 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f285bb57-5f84-4b85-bd57-e039a3cf9d9a None None] REQUEST_METHOD: `POST` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:27:46.896457 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f285bb57-5f84-4b85-bd57-e039a3cf9d9a None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:27:46.896554 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f285bb57-5f84-4b85-bd57-e039a3cf9d9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:27:46.915666 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.auth.core [None req-f285bb57-5f84-4b85-bd57-e039a3cf9d9a None None] MFA Rules not processed for user `3dbbb9909cec43ff99c1c3682f016ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=88080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:27:46.916868 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.fernet_utils [None req-f285bb57-5f84-4b85-bd57-e039a3cf9d9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:27:46.924652 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 522/1038] 127.0.0.1 () {58 vars in 998 bytes} [Sat Sep 24 19:27:46 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:27:47.089519 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e7090c-830d-4de9-be18-85eb5a358cbf None None] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:27:47.103720 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e7090c-830d-4de9-be18-85eb5a358cbf None None] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:27:47.109030 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e167fc-ea40-4f08-ae30-0f529009a535 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ab73abe1c6e4b25a17281f4cd8e97e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dfa5c2c17244006bdd629ec81553f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:27:47.109648 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e167fc-ea40-4f08-ae30-0f529009a535 service nova] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:27:47.109957 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e167fc-ea40-4f08-ae30-0f529009a535 service nova] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:27:47.110231 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e167fc-ea40-4f08-ae30-0f529009a535 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:27:47.119836 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e167fc-ea40-4f08-ae30-0f529009a535 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:27:47.121690 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e167fc-ea40-4f08-ae30-0f529009a535 service nova] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:27:47.131883 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 517/1039] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Sep 24 19:27:47 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:27:48.812671 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b88c264-9b3d-4198-8d64-d7c646c0832a None None] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:27:48.813305 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b88c264-9b3d-4198-8d64-d7c646c0832a None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:27:48.813305 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b88c264-9b3d-4198-8d64-d7c646c0832a None None] PATH_INFO: `/` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:27:48.814961 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 523/1040] 127.0.0.1 () {54 vars in 901 bytes} [Sat Sep 24 19:27:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:27:48.820271 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3181eda0-0493-44a4-8afe-e78e1cbb1677 None None] REQUEST_METHOD: `POST` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:27:48.820740 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3181eda0-0493-44a4-8afe-e78e1cbb1677 None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:27:48.820847 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3181eda0-0493-44a4-8afe-e78e1cbb1677 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:27:48.841542 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.auth.core [None req-3181eda0-0493-44a4-8afe-e78e1cbb1677 None None] MFA Rules not processed for user `3dbbb9909cec43ff99c1c3682f016ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=88081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:27:48.842781 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.fernet_utils [None req-3181eda0-0493-44a4-8afe-e78e1cbb1677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:27:48.850466 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 518/1041] 127.0.0.1 () {58 vars in 998 bytes} [Sat Sep 24 19:27:48 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:27:49.011810 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b88c264-9b3d-4198-8d64-d7c646c0832a None None] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:27:49.025225 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b88c264-9b3d-4198-8d64-d7c646c0832a None None] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:27:49.030336 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef16f544-007b-4549-b658-ecf261c52e26 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ab73abe1c6e4b25a17281f4cd8e97e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dfa5c2c17244006bdd629ec81553f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:27:49.030939 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef16f544-007b-4549-b658-ecf261c52e26 service nova] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:27:49.031217 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef16f544-007b-4549-b658-ecf261c52e26 service nova] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:27:49.031490 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef16f544-007b-4549-b658-ecf261c52e26 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:27:49.039916 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef16f544-007b-4549-b658-ecf261c52e26 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:27:49.041493 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef16f544-007b-4549-b658-ecf261c52e26 service nova] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:27:49.051004 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 524/1042] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Sep 24 19:27:49 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:27:50.731521 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3a26ee-715b-4daf-ae43-f34c007cff3b None None] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:27:50.732069 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3a26ee-715b-4daf-ae43-f34c007cff3b None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:27:50.732069 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3a26ee-715b-4daf-ae43-f34c007cff3b None None] PATH_INFO: `/` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:27:50.733378 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 519/1043] 127.0.0.1 () {54 vars in 901 bytes} [Sat Sep 24 19:27:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 24 19:27:50.738262 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c26c1e-90a9-4e06-be1c-4116154e997d None None] REQUEST_METHOD: `POST` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:27:50.738709 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c26c1e-90a9-4e06-be1c-4116154e997d None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:27:50.738815 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c26c1e-90a9-4e06-be1c-4116154e997d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:27:50.758932 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.auth.core [None req-75c26c1e-90a9-4e06-be1c-4116154e997d None None] MFA Rules not processed for user `3dbbb9909cec43ff99c1c3682f016ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=88080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:27:50.760544 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.fernet_utils [None req-75c26c1e-90a9-4e06-be1c-4116154e997d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:27:50.768500 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 525/1044] 127.0.0.1 () {58 vars in 998 bytes} [Sat Sep 24 19:27:50 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:27:50.925070 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3a26ee-715b-4daf-ae43-f34c007cff3b None None] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:27:50.944049 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3a26ee-715b-4daf-ae43-f34c007cff3b None None] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:27:50.952032 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7515c491-f70f-4014-b293-c379224b6c2b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ab73abe1c6e4b25a17281f4cd8e97e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dfa5c2c17244006bdd629ec81553f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:27:50.952638 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7515c491-f70f-4014-b293-c379224b6c2b service nova] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:27:50.952910 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7515c491-f70f-4014-b293-c379224b6c2b service nova] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:27:50.953175 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7515c491-f70f-4014-b293-c379224b6c2b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:27:50.963761 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7515c491-f70f-4014-b293-c379224b6c2b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:27:50.965571 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7515c491-f70f-4014-b293-c379224b6c2b service nova] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:27:50.979730 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 520/1045] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Sep 24 19:27:50 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:27:52.602411 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23551a90-188b-47f9-82a4-d935995caa98 None None] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:27:52.602992 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23551a90-188b-47f9-82a4-d935995caa98 None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:27:52.602992 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23551a90-188b-47f9-82a4-d935995caa98 None None] PATH_INFO: `/` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:27:52.604282 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 526/1046] 127.0.0.1 () {54 vars in 901 bytes} [Sat Sep 24 19:27:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 24 19:27:52.609218 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ea3aca-c64e-404d-9d6a-5ca11b3f76a8 None None] REQUEST_METHOD: `POST` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:27:52.609651 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ea3aca-c64e-404d-9d6a-5ca11b3f76a8 None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:27:52.609741 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ea3aca-c64e-404d-9d6a-5ca11b3f76a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:27:52.630495 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.auth.core [None req-60ea3aca-c64e-404d-9d6a-5ca11b3f76a8 None None] MFA Rules not processed for user `3dbbb9909cec43ff99c1c3682f016ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=88081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:27:52.631664 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.fernet_utils [None req-60ea3aca-c64e-404d-9d6a-5ca11b3f76a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:27:52.639903 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 521/1047] 127.0.0.1 () {58 vars in 998 bytes} [Sat Sep 24 19:27:52 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:27:52.802466 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23551a90-188b-47f9-82a4-d935995caa98 None None] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:27:52.817285 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23551a90-188b-47f9-82a4-d935995caa98 None None] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:27:52.823241 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836f6bd8-f335-442e-ab52-10fd1fb79d2b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ab73abe1c6e4b25a17281f4cd8e97e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dfa5c2c17244006bdd629ec81553f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:27:52.823929 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836f6bd8-f335-442e-ab52-10fd1fb79d2b service nova] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:27:52.824205 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836f6bd8-f335-442e-ab52-10fd1fb79d2b service nova] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:27:52.824471 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836f6bd8-f335-442e-ab52-10fd1fb79d2b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:27:52.833074 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836f6bd8-f335-442e-ab52-10fd1fb79d2b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:27:52.835033 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836f6bd8-f335-442e-ab52-10fd1fb79d2b service nova] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:27:52.844865 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 527/1048] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Sep 24 19:27:52 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:27:54.487527 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78400a6-9abe-4a73-8893-ce982fe96522 None None] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:27:54.488091 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78400a6-9abe-4a73-8893-ce982fe96522 None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:27:54.488091 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78400a6-9abe-4a73-8893-ce982fe96522 None None] PATH_INFO: `/` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:27:54.489387 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 522/1049] 127.0.0.1 () {54 vars in 901 bytes} [Sat Sep 24 19:27:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:27:54.494370 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8edf581-ab1c-4e25-9551-074503e18a67 None None] REQUEST_METHOD: `POST` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:27:54.494820 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8edf581-ab1c-4e25-9551-074503e18a67 None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:27:54.494927 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8edf581-ab1c-4e25-9551-074503e18a67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:27:54.514847 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.auth.core [None req-f8edf581-ab1c-4e25-9551-074503e18a67 None None] MFA Rules not processed for user `3dbbb9909cec43ff99c1c3682f016ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=88080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:27:54.516027 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.fernet_utils [None req-f8edf581-ab1c-4e25-9551-074503e18a67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:27:54.524091 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 528/1050] 127.0.0.1 () {58 vars in 998 bytes} [Sat Sep 24 19:27:54 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:27:54.687807 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78400a6-9abe-4a73-8893-ce982fe96522 None None] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:27:54.705112 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78400a6-9abe-4a73-8893-ce982fe96522 None None] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:27:54.710116 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd671c4d-5d93-4629-87de-a60b79933292 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ab73abe1c6e4b25a17281f4cd8e97e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dfa5c2c17244006bdd629ec81553f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:27:54.710719 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd671c4d-5d93-4629-87de-a60b79933292 service nova] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:27:54.710994 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd671c4d-5d93-4629-87de-a60b79933292 service nova] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:27:54.711262 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd671c4d-5d93-4629-87de-a60b79933292 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:27:54.720460 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd671c4d-5d93-4629-87de-a60b79933292 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:27:54.722056 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd671c4d-5d93-4629-87de-a60b79933292 service nova] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:27:54.731348 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 523/1051] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Sep 24 19:27:54 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:27:56.391514 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edb155e-11d6-46a3-94c2-5adafc7909f3 None None] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:27:56.392056 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edb155e-11d6-46a3-94c2-5adafc7909f3 None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:27:56.392151 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edb155e-11d6-46a3-94c2-5adafc7909f3 None None] PATH_INFO: `/` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:27:56.394165 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 529/1052] 127.0.0.1 () {54 vars in 901 bytes} [Sat Sep 24 19:27:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:27:56.398616 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04bce9c-6834-4009-9829-cd16c5b68e4f None None] REQUEST_METHOD: `POST` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:27:56.399078 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04bce9c-6834-4009-9829-cd16c5b68e4f None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:27:56.399198 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04bce9c-6834-4009-9829-cd16c5b68e4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:27:56.420285 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.auth.core [None req-b04bce9c-6834-4009-9829-cd16c5b68e4f None None] MFA Rules not processed for user `3dbbb9909cec43ff99c1c3682f016ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=88081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:27:56.421472 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.fernet_utils [None req-b04bce9c-6834-4009-9829-cd16c5b68e4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:27:56.429346 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 524/1053] 127.0.0.1 () {58 vars in 998 bytes} [Sat Sep 24 19:27:56 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:27:56.585358 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edb155e-11d6-46a3-94c2-5adafc7909f3 None None] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:27:56.598893 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edb155e-11d6-46a3-94c2-5adafc7909f3 None None] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:27:56.603786 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d67bc1f-3ca2-40e9-909e-c024ad2a1d0c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ab73abe1c6e4b25a17281f4cd8e97e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dfa5c2c17244006bdd629ec81553f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:27:56.604373 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d67bc1f-3ca2-40e9-909e-c024ad2a1d0c service nova] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:27:56.604650 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d67bc1f-3ca2-40e9-909e-c024ad2a1d0c service nova] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:27:56.604921 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d67bc1f-3ca2-40e9-909e-c024ad2a1d0c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:27:56.612813 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d67bc1f-3ca2-40e9-909e-c024ad2a1d0c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:27:56.614403 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d67bc1f-3ca2-40e9-909e-c024ad2a1d0c service nova] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:27:56.624296 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 530/1054] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Sep 24 19:27:56 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:27:58.248575 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9b6b2d-79f2-412b-96ce-4fd1f9bb8aa1 None None] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:27:58.249133 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9b6b2d-79f2-412b-96ce-4fd1f9bb8aa1 None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:27:58.249133 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9b6b2d-79f2-412b-96ce-4fd1f9bb8aa1 None None] PATH_INFO: `/` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:27:58.250766 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 525/1055] 127.0.0.1 () {54 vars in 901 bytes} [Sat Sep 24 19:27:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:27:58.256121 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2467b5-0d03-4b55-b5bf-4a5dafc21541 None None] REQUEST_METHOD: `POST` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:27:58.256629 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2467b5-0d03-4b55-b5bf-4a5dafc21541 None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:27:58.256766 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2467b5-0d03-4b55-b5bf-4a5dafc21541 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:27:58.280187 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.auth.core [None req-ac2467b5-0d03-4b55-b5bf-4a5dafc21541 None None] MFA Rules not processed for user `3dbbb9909cec43ff99c1c3682f016ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=88080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:27:58.281382 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.fernet_utils [None req-ac2467b5-0d03-4b55-b5bf-4a5dafc21541 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:27:58.289265 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 531/1056] 127.0.0.1 () {58 vars in 998 bytes} [Sat Sep 24 19:27:58 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:27:58.449093 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9b6b2d-79f2-412b-96ce-4fd1f9bb8aa1 None None] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:27:58.463013 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9b6b2d-79f2-412b-96ce-4fd1f9bb8aa1 None None] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:27:58.467880 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236694ad-dd05-4dfc-bc8f-b64b16130d84 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ab73abe1c6e4b25a17281f4cd8e97e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dfa5c2c17244006bdd629ec81553f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:27:58.468476 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236694ad-dd05-4dfc-bc8f-b64b16130d84 service nova] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:27:58.468751 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236694ad-dd05-4dfc-bc8f-b64b16130d84 service nova] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:27:58.469019 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236694ad-dd05-4dfc-bc8f-b64b16130d84 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:27:58.477322 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236694ad-dd05-4dfc-bc8f-b64b16130d84 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:27:58.479043 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236694ad-dd05-4dfc-bc8f-b64b16130d84 service nova] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:27:58.488628 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 526/1057] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Sep 24 19:27:58 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:28:00.817964 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fb074d-afe7-471c-b3d9-bad89496ed84 None None] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:28:00.818536 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fb074d-afe7-471c-b3d9-bad89496ed84 None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:28:00.818536 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fb074d-afe7-471c-b3d9-bad89496ed84 None None] PATH_INFO: `/` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:28:00.819844 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 532/1058] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 24 19:28:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:28:00.825276 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318b27c3-8cad-4868-865b-c0e1af249e00 None None] REQUEST_METHOD: `POST` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:28:00.825691 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318b27c3-8cad-4868-865b-c0e1af249e00 None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:28:00.825839 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318b27c3-8cad-4868-865b-c0e1af249e00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:28:00.844487 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.auth.core [None req-318b27c3-8cad-4868-865b-c0e1af249e00 None None] MFA Rules not processed for user `3dbbb9909cec43ff99c1c3682f016ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=88081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:28:00.845664 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.fernet_utils [None req-318b27c3-8cad-4868-865b-c0e1af249e00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:28:00.853906 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 527/1059] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 24 19:28:00 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:28:01.187044 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fb074d-afe7-471c-b3d9-bad89496ed84 None None] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:28:01.198118 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fb074d-afe7-471c-b3d9-bad89496ed84 None None] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:28:01.201734 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57c1d9c-4362-4957-8865-c1f3dd7b612b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ef291c173794b49ade9469a5ef72e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dfa5c2c17244006bdd629ec81553f1a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:28:01.202394 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57c1d9c-4362-4957-8865-c1f3dd7b612b service neutron] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:28:01.202669 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57c1d9c-4362-4957-8865-c1f3dd7b612b service neutron] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:28:01.202937 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57c1d9c-4362-4957-8865-c1f3dd7b612b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:28:01.212465 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57c1d9c-4362-4957-8865-c1f3dd7b612b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:28:01.213914 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57c1d9c-4362-4957-8865-c1f3dd7b612b service neutron] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:28:01.223476 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 533/1060] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Sep 24 19:28:01 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:28:03.800647 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a015220-f1a2-4bbb-af79-b6108119a46d None None] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:28:03.801206 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a015220-f1a2-4bbb-af79-b6108119a46d None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:28:03.801206 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a015220-f1a2-4bbb-af79-b6108119a46d None None] PATH_INFO: `/` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:28:03.802589 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 528/1061] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 24 19:28:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:28:03.810005 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9dbff2-2f69-4a3c-890a-4c9d178e84a3 None None] REQUEST_METHOD: `POST` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:28:03.810477 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9dbff2-2f69-4a3c-890a-4c9d178e84a3 None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:28:03.810581 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9dbff2-2f69-4a3c-890a-4c9d178e84a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:28:03.829465 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.auth.core [None req-df9dbff2-2f69-4a3c-890a-4c9d178e84a3 None None] MFA Rules not processed for user `3dbbb9909cec43ff99c1c3682f016ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=88080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:28:03.830592 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.fernet_utils [None req-df9dbff2-2f69-4a3c-890a-4c9d178e84a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:28:03.838606 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 534/1062] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 24 19:28:03 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:28:04.173108 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a015220-f1a2-4bbb-af79-b6108119a46d None None] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:28:04.184338 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a015220-f1a2-4bbb-af79-b6108119a46d None None] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:28:04.187804 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9130dcd-85ef-44d4-9757-72c6c0920439 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ef291c173794b49ade9469a5ef72e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dfa5c2c17244006bdd629ec81553f1a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:28:04.188400 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9130dcd-85ef-44d4-9757-72c6c0920439 service neutron] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:28:04.188674 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9130dcd-85ef-44d4-9757-72c6c0920439 service neutron] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:28:04.188943 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9130dcd-85ef-44d4-9757-72c6c0920439 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:28:04.197714 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9130dcd-85ef-44d4-9757-72c6c0920439 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:28:04.199219 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9130dcd-85ef-44d4-9757-72c6c0920439 service neutron] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:28:04.208373 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 529/1063] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Sep 24 19:28:04 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:28:06.975281 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f784895-4477-4484-964c-dcb774eb48a0 None None] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:28:06.975856 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f784895-4477-4484-964c-dcb774eb48a0 None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:28:06.975993 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f784895-4477-4484-964c-dcb774eb48a0 None None] PATH_INFO: `/` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:28:06.977280 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 535/1064] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 24 19:28:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:28:06.982712 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbab674-6916-4760-ab9d-43c6ec64a561 None None] REQUEST_METHOD: `POST` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:28:06.983103 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbab674-6916-4760-ab9d-43c6ec64a561 None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:28:06.983255 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbab674-6916-4760-ab9d-43c6ec64a561 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:28:07.002713 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.auth.core [None req-afbab674-6916-4760-ab9d-43c6ec64a561 None None] MFA Rules not processed for user `3dbbb9909cec43ff99c1c3682f016ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=88081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:28:07.003877 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.fernet_utils [None req-afbab674-6916-4760-ab9d-43c6ec64a561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:28:07.012186 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 530/1065] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 24 19:28:06 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:28:07.370074 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f784895-4477-4484-964c-dcb774eb48a0 None None] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:28:07.384395 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f784895-4477-4484-964c-dcb774eb48a0 None None] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:28:07.388460 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046985d4-baf0-4e31-a59e-010aafa25f21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ef291c173794b49ade9469a5ef72e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dfa5c2c17244006bdd629ec81553f1a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:28:07.389067 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046985d4-baf0-4e31-a59e-010aafa25f21 service neutron] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:28:07.389347 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046985d4-baf0-4e31-a59e-010aafa25f21 service neutron] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:28:07.389611 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046985d4-baf0-4e31-a59e-010aafa25f21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:28:07.400753 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046985d4-baf0-4e31-a59e-010aafa25f21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:28:07.402234 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046985d4-baf0-4e31-a59e-010aafa25f21 service neutron] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:28:07.412140 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 536/1066] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Sep 24 19:28:07 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:28:09.973964 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3950dbb-f782-465f-8f67-6d2c2b547183 None None] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:28:09.974605 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3950dbb-f782-465f-8f67-6d2c2b547183 None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:28:09.974605 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3950dbb-f782-465f-8f67-6d2c2b547183 None None] PATH_INFO: `/` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:28:09.975812 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 531/1067] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 24 19:28:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:28:09.981042 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f330084-89e0-4e7f-a17c-04db88c30326 None None] REQUEST_METHOD: `POST` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:28:09.981465 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f330084-89e0-4e7f-a17c-04db88c30326 None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:28:09.981611 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f330084-89e0-4e7f-a17c-04db88c30326 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:28:09.989648 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=60 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:28:10.003039 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.auth.core [None req-8f330084-89e0-4e7f-a17c-04db88c30326 None None] MFA Rules not processed for user `3dbbb9909cec43ff99c1c3682f016ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=88080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:28:10.004219 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.fernet_utils [None req-8f330084-89e0-4e7f-a17c-04db88c30326 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:28:10.012571 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 537/1068] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 24 19:28:09 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:28:10.364876 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3950dbb-f782-465f-8f67-6d2c2b547183 None None] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:28:10.377414 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3950dbb-f782-465f-8f67-6d2c2b547183 None None] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:28:10.380970 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9402018-c1b3-425e-90ce-ddc4d17fe9e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ef291c173794b49ade9469a5ef72e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dfa5c2c17244006bdd629ec81553f1a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:28:10.381586 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9402018-c1b3-425e-90ce-ddc4d17fe9e8 service neutron] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:28:10.381894 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9402018-c1b3-425e-90ce-ddc4d17fe9e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:28:10.382162 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9402018-c1b3-425e-90ce-ddc4d17fe9e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:28:10.391875 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9402018-c1b3-425e-90ce-ddc4d17fe9e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:28:10.393272 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9402018-c1b3-425e-90ce-ddc4d17fe9e8 service neutron] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:28:10.403303 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 532/1069] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Sep 24 19:28:10 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:28:12.917560 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397b5b03-4675-4390-9344-e2ddded1d972 None None] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:28:12.918163 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397b5b03-4675-4390-9344-e2ddded1d972 None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:28:12.918163 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397b5b03-4675-4390-9344-e2ddded1d972 None None] PATH_INFO: `/` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:28:12.919483 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 538/1070] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 24 19:28:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 24 19:28:12.925172 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3459b549-d73a-476d-93d1-49796a91e28b None None] REQUEST_METHOD: `POST` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:28:12.925672 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3459b549-d73a-476d-93d1-49796a91e28b None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:28:12.925789 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3459b549-d73a-476d-93d1-49796a91e28b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:28:12.933509 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=61 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:28:12.946828 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.auth.core [None req-3459b549-d73a-476d-93d1-49796a91e28b None None] MFA Rules not processed for user `3dbbb9909cec43ff99c1c3682f016ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=88081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:28:12.948020 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.fernet_utils [None req-3459b549-d73a-476d-93d1-49796a91e28b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:28:12.955703 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 533/1071] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 24 19:28:12 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 19:28:13.294723 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397b5b03-4675-4390-9344-e2ddded1d972 None None] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:28:13.306267 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397b5b03-4675-4390-9344-e2ddded1d972 None None] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:28:13.309722 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5419e24d-0c4a-4b85-a030-122a43d7d591 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ef291c173794b49ade9469a5ef72e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dfa5c2c17244006bdd629ec81553f1a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:28:13.310396 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5419e24d-0c4a-4b85-a030-122a43d7d591 service neutron] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:28:13.310668 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5419e24d-0c4a-4b85-a030-122a43d7d591 service neutron] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:28:13.310936 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5419e24d-0c4a-4b85-a030-122a43d7d591 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:28:13.320740 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5419e24d-0c4a-4b85-a030-122a43d7d591 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:28:13.322323 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5419e24d-0c4a-4b85-a030-122a43d7d591 service neutron] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:28:13.332357 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 539/1072] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Sep 24 19:28:13 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:28:15.854813 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc326bb-5ae9-4757-98b3-32adc3ed867d None None] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:28:15.855335 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc326bb-5ae9-4757-98b3-32adc3ed867d None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:28:15.855335 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc326bb-5ae9-4757-98b3-32adc3ed867d None None] PATH_INFO: `/` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:28:15.856683 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 534/1073] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 24 19:28:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:28:15.861997 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b087a6f-2532-460a-ab03-8390e3150699 None None] REQUEST_METHOD: `POST` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:28:15.862463 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b087a6f-2532-460a-ab03-8390e3150699 None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:28:15.862568 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b087a6f-2532-460a-ab03-8390e3150699 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:28:15.882691 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.auth.core [None req-9b087a6f-2532-460a-ab03-8390e3150699 None None] MFA Rules not processed for user `3dbbb9909cec43ff99c1c3682f016ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=88080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:28:15.883879 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.fernet_utils [None req-9b087a6f-2532-460a-ab03-8390e3150699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:28:15.891500 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 540/1074] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 24 19:28:15 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 19:28:16.226180 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc326bb-5ae9-4757-98b3-32adc3ed867d None None] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:28:16.237567 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc326bb-5ae9-4757-98b3-32adc3ed867d None None] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:28:16.241111 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8d8c33-56a2-4566-af44-ab039c0f0c2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ef291c173794b49ade9469a5ef72e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dfa5c2c17244006bdd629ec81553f1a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:28:16.241704 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8d8c33-56a2-4566-af44-ab039c0f0c2f service neutron] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:28:16.242025 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8d8c33-56a2-4566-af44-ab039c0f0c2f service neutron] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:28:16.242298 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8d8c33-56a2-4566-af44-ab039c0f0c2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:28:16.253327 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8d8c33-56a2-4566-af44-ab039c0f0c2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:28:16.254931 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8d8c33-56a2-4566-af44-ab039c0f0c2f service neutron] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:28:16.264761 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 535/1075] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Sep 24 19:28:16 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:28:18.803556 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b10967-4459-4dc1-a064-a9808b8c805f None None] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:28:18.804109 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b10967-4459-4dc1-a064-a9808b8c805f None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:28:18.804109 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b10967-4459-4dc1-a064-a9808b8c805f None None] PATH_INFO: `/` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:28:18.805435 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 541/1076] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 24 19:28:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:28:18.811107 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4203b7b-4d44-4515-97f6-21e54c47ece8 None None] REQUEST_METHOD: `POST` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:28:18.811629 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4203b7b-4d44-4515-97f6-21e54c47ece8 None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:28:18.811738 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4203b7b-4d44-4515-97f6-21e54c47ece8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:28:18.831531 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.auth.core [None req-d4203b7b-4d44-4515-97f6-21e54c47ece8 None None] MFA Rules not processed for user `3dbbb9909cec43ff99c1c3682f016ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=88081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:28:18.832931 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.fernet_utils [None req-d4203b7b-4d44-4515-97f6-21e54c47ece8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:28:18.841515 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 536/1077] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 24 19:28:18 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:28:19.176496 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b10967-4459-4dc1-a064-a9808b8c805f None None] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:28:19.187499 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b10967-4459-4dc1-a064-a9808b8c805f None None] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:28:19.190962 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fcedc5-79c8-4c10-a587-ab406d450161 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ef291c173794b49ade9469a5ef72e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dfa5c2c17244006bdd629ec81553f1a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:28:19.191547 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fcedc5-79c8-4c10-a587-ab406d450161 service neutron] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:28:19.191823 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fcedc5-79c8-4c10-a587-ab406d450161 service neutron] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:28:19.192095 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fcedc5-79c8-4c10-a587-ab406d450161 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:28:19.201192 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fcedc5-79c8-4c10-a587-ab406d450161 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:28:19.202702 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fcedc5-79c8-4c10-a587-ab406d450161 service neutron] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:28:19.213033 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 542/1078] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Sep 24 19:28:19 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:28:21.746062 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b13ebab-e55a-4260-b4f4-d1bf109ec918 None None] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:28:21.746603 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b13ebab-e55a-4260-b4f4-d1bf109ec918 None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:28:21.746603 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b13ebab-e55a-4260-b4f4-d1bf109ec918 None None] PATH_INFO: `/` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:28:21.748211 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 537/1079] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 24 19:28:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:28:21.753632 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727ae1fe-6590-4ffe-bb86-5be0601500f0 None None] REQUEST_METHOD: `POST` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:28:21.754132 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727ae1fe-6590-4ffe-bb86-5be0601500f0 None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:28:21.754237 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727ae1fe-6590-4ffe-bb86-5be0601500f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:28:21.773618 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.auth.core [None req-727ae1fe-6590-4ffe-bb86-5be0601500f0 None None] MFA Rules not processed for user `3dbbb9909cec43ff99c1c3682f016ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=88080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:28:21.774914 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.fernet_utils [None req-727ae1fe-6590-4ffe-bb86-5be0601500f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:28:21.782813 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 543/1080] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 24 19:28:21 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 19:28:22.127421 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b13ebab-e55a-4260-b4f4-d1bf109ec918 None None] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:28:22.138207 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b13ebab-e55a-4260-b4f4-d1bf109ec918 None None] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:28:22.141655 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f4d8d5-f86c-4065-8970-242fad281423 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ef291c173794b49ade9469a5ef72e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dfa5c2c17244006bdd629ec81553f1a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:28:22.142282 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f4d8d5-f86c-4065-8970-242fad281423 service neutron] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:28:22.142558 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f4d8d5-f86c-4065-8970-242fad281423 service neutron] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:28:22.142824 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f4d8d5-f86c-4065-8970-242fad281423 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:28:22.152256 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f4d8d5-f86c-4065-8970-242fad281423 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:28:22.153674 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f4d8d5-f86c-4065-8970-242fad281423 service neutron] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:28:22.163205 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 538/1081] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Sep 24 19:28:22 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:28:24.583450 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c177bd-d62f-4b4c-b8ab-a8c276fb19a6 None None] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:28:24.584017 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c177bd-d62f-4b4c-b8ab-a8c276fb19a6 None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:28:24.584017 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c177bd-d62f-4b4c-b8ab-a8c276fb19a6 None None] PATH_INFO: `/` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:28:24.585300 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 544/1082] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 24 19:28:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 24 19:28:24.591974 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576a0813-8f37-49ce-994b-ae51f6a298c0 None None] REQUEST_METHOD: `POST` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:28:24.591974 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576a0813-8f37-49ce-994b-ae51f6a298c0 None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:28:24.591974 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576a0813-8f37-49ce-994b-ae51f6a298c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:28:24.610934 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.auth.core [None req-576a0813-8f37-49ce-994b-ae51f6a298c0 None None] MFA Rules not processed for user `3dbbb9909cec43ff99c1c3682f016ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=88081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:28:24.612125 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.fernet_utils [None req-576a0813-8f37-49ce-994b-ae51f6a298c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:28:24.619853 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 539/1083] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 24 19:28:24 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:28:24.958132 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c177bd-d62f-4b4c-b8ab-a8c276fb19a6 None None] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:28:24.968812 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c177bd-d62f-4b4c-b8ab-a8c276fb19a6 None None] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:28:24.972391 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb22f4b4-3782-42dc-b50d-ba012353ade5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ef291c173794b49ade9469a5ef72e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dfa5c2c17244006bdd629ec81553f1a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:28:24.972977 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb22f4b4-3782-42dc-b50d-ba012353ade5 service neutron] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:28:24.973253 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb22f4b4-3782-42dc-b50d-ba012353ade5 service neutron] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:28:24.973518 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb22f4b4-3782-42dc-b50d-ba012353ade5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:28:24.982275 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb22f4b4-3782-42dc-b50d-ba012353ade5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:28:24.983696 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb22f4b4-3782-42dc-b50d-ba012353ade5 service neutron] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:28:24.993452 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 545/1084] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Sep 24 19:28:24 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:28:27.454721 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70eae1c-05ae-4a5e-9091-01a317f7dae5 None None] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:28:27.455619 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70eae1c-05ae-4a5e-9091-01a317f7dae5 None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:28:27.455619 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70eae1c-05ae-4a5e-9091-01a317f7dae5 None None] PATH_INFO: `/` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:28:27.456621 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 540/1085] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 24 19:28:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 24 19:28:27.462923 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7959ab-aa83-404e-98b1-7561e69b4fa7 None None] REQUEST_METHOD: `POST` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:28:27.463365 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7959ab-aa83-404e-98b1-7561e69b4fa7 None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:28:27.463530 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7959ab-aa83-404e-98b1-7561e69b4fa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:28:27.483179 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.auth.core [None req-ce7959ab-aa83-404e-98b1-7561e69b4fa7 None None] MFA Rules not processed for user `3dbbb9909cec43ff99c1c3682f016ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=88080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:28:27.484361 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.fernet_utils [None req-ce7959ab-aa83-404e-98b1-7561e69b4fa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:28:27.492065 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 546/1086] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 24 19:28:27 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:28:27.838085 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70eae1c-05ae-4a5e-9091-01a317f7dae5 None None] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:28:27.849562 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70eae1c-05ae-4a5e-9091-01a317f7dae5 None None] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:28:27.853208 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bae8bf-a42f-4e3a-ad29-adc9235fa05f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ef291c173794b49ade9469a5ef72e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dfa5c2c17244006bdd629ec81553f1a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:28:27.854026 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bae8bf-a42f-4e3a-ad29-adc9235fa05f service neutron] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:28:27.854413 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bae8bf-a42f-4e3a-ad29-adc9235fa05f service neutron] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:28:27.854818 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bae8bf-a42f-4e3a-ad29-adc9235fa05f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:28:27.865745 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bae8bf-a42f-4e3a-ad29-adc9235fa05f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:28:27.867294 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bae8bf-a42f-4e3a-ad29-adc9235fa05f service neutron] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:28:27.879658 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 541/1087] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Sep 24 19:28:27 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:28:37.478527 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=29 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:28:37.875279 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=26 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:28:53.045138 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93e415b-a43d-4591-bc70-dc4e9bdf06ad None None] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:28:53.045690 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93e415b-a43d-4591-bc70-dc4e9bdf06ad None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:28:53.045690 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93e415b-a43d-4591-bc70-dc4e9bdf06ad None None] PATH_INFO: `/` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:28:53.046980 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 547/1088] 10.222.0.18 () {54 vars in 927 bytes} [Sat Sep 24 19:28:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:28:53.052219 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4ca9b6-6ae7-4018-9d86-529ff232643f None None] REQUEST_METHOD: `POST` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:28:53.052596 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4ca9b6-6ae7-4018-9d86-529ff232643f None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:28:53.052775 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4ca9b6-6ae7-4018-9d86-529ff232643f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:28:53.072039 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.auth.core [None req-7f4ca9b6-6ae7-4018-9d86-529ff232643f None None] MFA Rules not processed for user `3dbbb9909cec43ff99c1c3682f016ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=88081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:28:53.073250 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.fernet_utils [None req-7f4ca9b6-6ae7-4018-9d86-529ff232643f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:28:53.080865 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 542/1089] 10.222.0.18 () {58 vars in 1024 bytes} [Sat Sep 24 19:28:53 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:28:53.435322 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570bcf1e-34ce-4c2f-8469-4e80bce55ac5 None None] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:28:53.435603 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570bcf1e-34ce-4c2f-8469-4e80bce55ac5 None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:28:53.435903 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570bcf1e-34ce-4c2f-8469-4e80bce55ac5 None None] PATH_INFO: `/` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:28:53.437219 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 548/1090] 10.222.0.18 () {54 vars in 962 bytes} [Sat Sep 24 19:28:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:28:53.442480 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac454ab-790b-4882-a4a5-4d53e1a6320d None None] REQUEST_METHOD: `POST` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:28:53.442767 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac454ab-790b-4882-a4a5-4d53e1a6320d None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:28:53.443044 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac454ab-790b-4882-a4a5-4d53e1a6320d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:28:53.465421 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.auth.core [None req-5ac454ab-790b-4882-a4a5-4d53e1a6320d None None] MFA Rules not processed for user `135ee6a2c657412ba6d65a51403ef4d6`. Rule list: `[]` (Enabled: `True`). {{(pid=88081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:28:53.467097 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.fernet_utils [None req-5ac454ab-790b-4882-a4a5-4d53e1a6320d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:28:53.476478 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 543/1091] 10.222.0.18 () {58 vars in 1059 bytes} [Sat Sep 24 19:28:53 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:28:53.485742 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570bcf1e-34ce-4c2f-8469-4e80bce55ac5 None None] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:28:53.496743 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570bcf1e-34ce-4c2f-8469-4e80bce55ac5 None None] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:28:53.500535 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fd8db2-d1a6-4809-99d6-e51856883e58 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '135ee6a2c657412ba6d65a51403ef4d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dfa5c2c17244006bdd629ec81553f1a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:28:53.501122 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fd8db2-d1a6-4809-99d6-e51856883e58 service glance] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:28:53.501398 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fd8db2-d1a6-4809-99d6-e51856883e58 service glance] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:28:53.501666 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fd8db2-d1a6-4809-99d6-e51856883e58 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:28:53.510429 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fd8db2-d1a6-4809-99d6-e51856883e58 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:28:53.511832 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fd8db2-d1a6-4809-99d6-e51856883e58 service glance] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:28:53.520976 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 549/1092] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Sep 24 19:28:53 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:28:56.021092 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6866d53b-fc31-44ee-a4cd-30f6448209dd None None] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:28:56.021616 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6866d53b-fc31-44ee-a4cd-30f6448209dd None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:28:56.021616 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6866d53b-fc31-44ee-a4cd-30f6448209dd None None] PATH_INFO: `/` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:28:56.022892 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 544/1093] 10.222.0.18 () {54 vars in 927 bytes} [Sat Sep 24 19:28:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:28:56.028256 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683fe121-38cb-40db-ab44-d96632bdd1bb None None] REQUEST_METHOD: `POST` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:28:56.028669 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683fe121-38cb-40db-ab44-d96632bdd1bb None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:28:56.028790 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683fe121-38cb-40db-ab44-d96632bdd1bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:28:56.048083 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.auth.core [None req-683fe121-38cb-40db-ab44-d96632bdd1bb None None] MFA Rules not processed for user `3dbbb9909cec43ff99c1c3682f016ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=88080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:28:56.049262 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.fernet_utils [None req-683fe121-38cb-40db-ab44-d96632bdd1bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:28:56.057579 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 550/1094] 10.222.0.18 () {58 vars in 1024 bytes} [Sat Sep 24 19:28:56 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:28:56.382723 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6866d53b-fc31-44ee-a4cd-30f6448209dd None None] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:28:56.395135 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6866d53b-fc31-44ee-a4cd-30f6448209dd None None] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:28:56.399476 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199c29ad-625d-4445-becd-6a99f7137c77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fc67bd325c24a418945f738b4bd5c71', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:28:56.400081 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199c29ad-625d-4445-becd-6a99f7137c77 admin admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:28:56.400846 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199c29ad-625d-4445-becd-6a99f7137c77 admin admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:28:56.401111 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199c29ad-625d-4445-becd-6a99f7137c77 admin admin] PATH_INFO: `/v3/projects` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:28:56.401732 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199c29ad-625d-4445-becd-6a99f7137c77 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:28:56.403527 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: WARNING py.warnings [None req-199c29ad-625d-4445-becd-6a99f7137c77 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 24 19:28:56.403527 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: warnings.warn(msg) Sep 24 19:28:56.403527 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: Sep 24 19:28:56.404643 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199c29ad-625d-4445-becd-6a99f7137c77 admin admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:28:56.423515 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 545/1095] 10.222.0.18 () {56 vars in 1108 bytes} [Sat Sep 24 19:28:56 2022] GET /identity/v3/projects => generated 1606 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 19:28:58.877437 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6df560-4319-406a-9553-c1e6a8fc0cf8 None None] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:28:58.877995 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6df560-4319-406a-9553-c1e6a8fc0cf8 None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:28:58.877995 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6df560-4319-406a-9553-c1e6a8fc0cf8 None None] PATH_INFO: `/` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:28:58.879368 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 551/1096] 10.222.0.18 () {54 vars in 927 bytes} [Sat Sep 24 19:28:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:28:58.884445 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a21d99-c625-4823-8ac5-6c75b9c2f83f None None] REQUEST_METHOD: `POST` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:28:58.884823 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a21d99-c625-4823-8ac5-6c75b9c2f83f None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:28:58.885019 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a21d99-c625-4823-8ac5-6c75b9c2f83f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:28:58.904188 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.auth.core [None req-34a21d99-c625-4823-8ac5-6c75b9c2f83f None None] MFA Rules not processed for user `3dbbb9909cec43ff99c1c3682f016ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=88081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:28:58.905353 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.fernet_utils [None req-34a21d99-c625-4823-8ac5-6c75b9c2f83f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:28:58.912878 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 546/1097] 10.222.0.18 () {58 vars in 1024 bytes} [Sat Sep 24 19:28:58 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:28:59.255509 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6df560-4319-406a-9553-c1e6a8fc0cf8 None None] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:28:59.268816 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6df560-4319-406a-9553-c1e6a8fc0cf8 None None] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:28:59.273848 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6fd40d-798a-4886-a355-97d1c1d6fa6f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ab73abe1c6e4b25a17281f4cd8e97e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dfa5c2c17244006bdd629ec81553f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:28:59.274433 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6fd40d-798a-4886-a355-97d1c1d6fa6f service nova] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:28:59.274708 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6fd40d-798a-4886-a355-97d1c1d6fa6f service nova] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:28:59.274978 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6fd40d-798a-4886-a355-97d1c1d6fa6f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:28:59.282977 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6fd40d-798a-4886-a355-97d1c1d6fa6f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:28:59.284543 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6fd40d-798a-4886-a355-97d1c1d6fa6f service nova] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:28:59.294490 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 552/1098] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Sep 24 19:28:59 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:29:01.908186 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4380a5ca-9649-4dfa-b763-bb6fe10eb576 None None] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:29:01.908765 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4380a5ca-9649-4dfa-b763-bb6fe10eb576 None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:29:01.908765 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4380a5ca-9649-4dfa-b763-bb6fe10eb576 None None] PATH_INFO: `/` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:29:01.910007 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 547/1099] 10.222.0.18 () {54 vars in 927 bytes} [Sat Sep 24 19:29:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:29:01.915261 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0039cf-90e4-4328-a387-4c54b289327e None None] REQUEST_METHOD: `POST` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:29:01.915955 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0039cf-90e4-4328-a387-4c54b289327e None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:29:01.915955 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0039cf-90e4-4328-a387-4c54b289327e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:29:01.935265 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.auth.core [None req-3e0039cf-90e4-4328-a387-4c54b289327e None None] MFA Rules not processed for user `3dbbb9909cec43ff99c1c3682f016ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=88080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:29:01.936434 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.fernet_utils [None req-3e0039cf-90e4-4328-a387-4c54b289327e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:29:01.944278 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 553/1100] 10.222.0.18 () {58 vars in 1024 bytes} [Sat Sep 24 19:29:01 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:29:02.275591 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4380a5ca-9649-4dfa-b763-bb6fe10eb576 None None] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:29:02.287029 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4380a5ca-9649-4dfa-b763-bb6fe10eb576 None None] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:29:02.291426 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c52647f-45c3-4a71-9d0f-76e26226a29e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ef291c173794b49ade9469a5ef72e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dfa5c2c17244006bdd629ec81553f1a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:29:02.292023 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c52647f-45c3-4a71-9d0f-76e26226a29e service neutron] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:29:02.292302 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c52647f-45c3-4a71-9d0f-76e26226a29e service neutron] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:29:02.292575 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c52647f-45c3-4a71-9d0f-76e26226a29e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:29:02.301685 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c52647f-45c3-4a71-9d0f-76e26226a29e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:29:02.303124 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c52647f-45c3-4a71-9d0f-76e26226a29e service neutron] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:29:02.312835 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 548/1101] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Sep 24 19:29:02 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:29:04.743743 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa3b4cf-2f9b-47e2-a4a8-13384442bf83 None None] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:29:04.744307 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa3b4cf-2f9b-47e2-a4a8-13384442bf83 None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:29:04.744307 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa3b4cf-2f9b-47e2-a4a8-13384442bf83 None None] PATH_INFO: `/` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:29:04.745601 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 554/1102] 10.222.0.18 () {54 vars in 927 bytes} [Sat Sep 24 19:29:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:29:04.751027 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d691e372-0fcf-4d57-83e5-0193a91789ce None None] REQUEST_METHOD: `POST` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:29:04.751432 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d691e372-0fcf-4d57-83e5-0193a91789ce None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:29:04.751561 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d691e372-0fcf-4d57-83e5-0193a91789ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:29:04.770502 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.auth.core [None req-d691e372-0fcf-4d57-83e5-0193a91789ce None None] MFA Rules not processed for user `3dbbb9909cec43ff99c1c3682f016ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=88081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:29:04.771682 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.fernet_utils [None req-d691e372-0fcf-4d57-83e5-0193a91789ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:29:04.779847 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 549/1103] 10.222.0.18 () {58 vars in 1024 bytes} [Sat Sep 24 19:29:04 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:29:05.114257 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa3b4cf-2f9b-47e2-a4a8-13384442bf83 None None] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:29:05.125205 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa3b4cf-2f9b-47e2-a4a8-13384442bf83 None None] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:29:05.128636 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96face20-69e8-47db-9c84-9ade7e97b1ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ef291c173794b49ade9469a5ef72e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dfa5c2c17244006bdd629ec81553f1a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:29:05.129227 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96face20-69e8-47db-9c84-9ade7e97b1ea service neutron] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:29:05.129502 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96face20-69e8-47db-9c84-9ade7e97b1ea service neutron] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:29:05.129772 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96face20-69e8-47db-9c84-9ade7e97b1ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:29:05.139024 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96face20-69e8-47db-9c84-9ade7e97b1ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:29:05.140437 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96face20-69e8-47db-9c84-9ade7e97b1ea service neutron] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:29:05.149626 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 555/1104] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Sep 24 19:29:05 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:29:07.657201 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b5150e-1c3c-4c21-a44e-54f08e09e9b0 None None] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:29:07.657744 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b5150e-1c3c-4c21-a44e-54f08e09e9b0 None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:29:07.657744 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b5150e-1c3c-4c21-a44e-54f08e09e9b0 None None] PATH_INFO: `/` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:29:07.659117 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 550/1105] 10.222.0.18 () {54 vars in 927 bytes} [Sat Sep 24 19:29:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:29:07.664433 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d1820b-de5c-4207-a18c-c50361226a92 None None] REQUEST_METHOD: `POST` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:29:07.664908 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d1820b-de5c-4207-a18c-c50361226a92 None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:29:07.665009 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d1820b-de5c-4207-a18c-c50361226a92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:29:07.685484 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.auth.core [None req-41d1820b-de5c-4207-a18c-c50361226a92 None None] MFA Rules not processed for user `3dbbb9909cec43ff99c1c3682f016ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=88080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:29:07.686727 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.fernet_utils [None req-41d1820b-de5c-4207-a18c-c50361226a92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:29:07.694542 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 556/1106] 10.222.0.18 () {58 vars in 1024 bytes} [Sat Sep 24 19:29:07 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:29:08.037496 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b5150e-1c3c-4c21-a44e-54f08e09e9b0 None None] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:29:08.047970 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b5150e-1c3c-4c21-a44e-54f08e09e9b0 None None] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:29:08.051414 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79aefba0-c84e-4fbe-bd3f-d3a947f88d97 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ef291c173794b49ade9469a5ef72e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dfa5c2c17244006bdd629ec81553f1a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:29:08.051992 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aefba0-c84e-4fbe-bd3f-d3a947f88d97 service neutron] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:29:08.052292 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aefba0-c84e-4fbe-bd3f-d3a947f88d97 service neutron] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:29:08.052554 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aefba0-c84e-4fbe-bd3f-d3a947f88d97 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:29:08.061021 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79aefba0-c84e-4fbe-bd3f-d3a947f88d97 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:29:08.062452 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79aefba0-c84e-4fbe-bd3f-d3a947f88d97 service neutron] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:29:08.071392 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 551/1107] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Sep 24 19:29:08 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:29:10.865724 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dcbb6e-167b-46cf-b6a6-0991ff1959e4 None None] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:29:10.866321 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dcbb6e-167b-46cf-b6a6-0991ff1959e4 None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:29:10.866321 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dcbb6e-167b-46cf-b6a6-0991ff1959e4 None None] PATH_INFO: `/` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:29:10.867608 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 557/1108] 10.222.0.18 () {54 vars in 927 bytes} [Sat Sep 24 19:29:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:29:10.874302 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e02368-161f-436f-8cc8-6f7321f6590f None None] REQUEST_METHOD: `POST` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:29:10.874825 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e02368-161f-436f-8cc8-6f7321f6590f None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:29:10.874998 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e02368-161f-436f-8cc8-6f7321f6590f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:29:10.898441 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.auth.core [None req-03e02368-161f-436f-8cc8-6f7321f6590f None None] MFA Rules not processed for user `3dbbb9909cec43ff99c1c3682f016ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=88081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:29:10.899629 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.fernet_utils [None req-03e02368-161f-436f-8cc8-6f7321f6590f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:29:10.907714 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 552/1109] 10.222.0.18 () {58 vars in 1024 bytes} [Sat Sep 24 19:29:10 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:29:11.283135 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dcbb6e-167b-46cf-b6a6-0991ff1959e4 None None] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:29:11.296856 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dcbb6e-167b-46cf-b6a6-0991ff1959e4 None None] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:29:11.300643 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3032d831-89f7-4d9e-b67f-d49964b5efec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ef291c173794b49ade9469a5ef72e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dfa5c2c17244006bdd629ec81553f1a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:29:11.301247 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3032d831-89f7-4d9e-b67f-d49964b5efec service neutron] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:29:11.301546 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3032d831-89f7-4d9e-b67f-d49964b5efec service neutron] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:29:11.301822 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3032d831-89f7-4d9e-b67f-d49964b5efec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:29:11.314080 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3032d831-89f7-4d9e-b67f-d49964b5efec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:29:11.316029 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3032d831-89f7-4d9e-b67f-d49964b5efec service neutron] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:29:11.326735 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 558/1110] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Sep 24 19:29:11 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:29:20.892721 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=33 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:29:21.322667 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=33 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:30:26.568302 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1d4cfa-724a-4d9a-b5ee-9931e7110e4d None None] REQUEST_METHOD: `POST` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:30:26.568910 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1d4cfa-724a-4d9a-b5ee-9931e7110e4d None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:30:26.568910 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1d4cfa-724a-4d9a-b5ee-9931e7110e4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:30:26.641428 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.auth.core [None req-0b1d4cfa-724a-4d9a-b5ee-9931e7110e4d None None] MFA Rules not processed for user `3dbbb9909cec43ff99c1c3682f016ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=88081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:30:26.642683 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.fernet_utils [None req-0b1d4cfa-724a-4d9a-b5ee-9931e7110e4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:30:26.689451 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 553/1111] 10.222.0.18 () {58 vars in 958 bytes} [Sat Sep 24 19:30:26 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:30:26.698376 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43715d74-ae3f-44f6-99f7-bf47a083aa40 None None] REQUEST_METHOD: `POST` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:30:26.698967 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43715d74-ae3f-44f6-99f7-bf47a083aa40 None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:30:26.698967 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43715d74-ae3f-44f6-99f7-bf47a083aa40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:30:26.718460 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.auth.core [None req-43715d74-ae3f-44f6-99f7-bf47a083aa40 None None] MFA Rules not processed for user `3dbbb9909cec43ff99c1c3682f016ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=88080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:30:26.719685 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.fernet_utils [None req-43715d74-ae3f-44f6-99f7-bf47a083aa40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:30:26.728041 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 559/1112] 10.222.0.18 () {58 vars in 958 bytes} [Sat Sep 24 19:30:26 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:30:26.732792 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1d4cfa-724a-4d9a-b5ee-9931e7110e4d None None] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:30:26.744787 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1d4cfa-724a-4d9a-b5ee-9931e7110e4d None None] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:30:26.749521 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5c6345-a035-4374-b5e1-dd21a4004f7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fc67bd325c24a418945f738b4bd5c71', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:30:26.750156 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5c6345-a035-4374-b5e1-dd21a4004f7e admin admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:30:26.750431 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5c6345-a035-4374-b5e1-dd21a4004f7e admin admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:30:26.750696 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5c6345-a035-4374-b5e1-dd21a4004f7e admin admin] PATH_INFO: `/v3/domains` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:30:26.751385 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5c6345-a035-4374-b5e1-dd21a4004f7e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:30:26.751683 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5c6345-a035-4374-b5e1-dd21a4004f7e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:30:26.752676 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: WARNING py.warnings [None req-fd5c6345-a035-4374-b5e1-dd21a4004f7e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 24 19:30:26.752676 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: warnings.warn(msg) Sep 24 19:30:26.752676 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: Sep 24 19:30:26.753543 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5c6345-a035-4374-b5e1-dd21a4004f7e admin admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:30:26.766950 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 554/1113] 10.222.0.18 () {58 vars in 1153 bytes} [Sat Sep 24 19:30:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:30:26.776381 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43715d74-ae3f-44f6-99f7-bf47a083aa40 None None] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:30:26.785739 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43715d74-ae3f-44f6-99f7-bf47a083aa40 None None] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:30:26.791503 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf70731-00c3-4274-87df-86c189791870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fc67bd325c24a418945f738b4bd5c71', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:30:26.792110 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf70731-00c3-4274-87df-86c189791870 admin admin] REQUEST_METHOD: `POST` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:30:26.792473 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf70731-00c3-4274-87df-86c189791870 admin admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:30:26.792745 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf70731-00c3-4274-87df-86c189791870 admin admin] PATH_INFO: `/v3/projects` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:30:26.793394 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf70731-00c3-4274-87df-86c189791870 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:30:26.795449 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: WARNING py.warnings [None req-7cf70731-00c3-4274-87df-86c189791870 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 24 19:30:26.795449 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: warnings.warn(msg) Sep 24 19:30:26.795449 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: Sep 24 19:30:26.796590 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf70731-00c3-4274-87df-86c189791870 admin admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:30:26.844933 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 560/1114] 10.222.0.18 () {60 vars in 1153 bytes} [Sat Sep 24 19:30:26 2022] POST /identity/v3/projects => generated 379 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:30:26.846502 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5c6345-a035-4374-b5e1-dd21a4004f7e admin admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:30:26.857687 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5c6345-a035-4374-b5e1-dd21a4004f7e admin admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:30:26.924426 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4a983f-3823-496e-b1af-cd4ce3139c33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fc67bd325c24a418945f738b4bd5c71', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:30:26.925028 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4a983f-3823-496e-b1af-cd4ce3139c33 admin admin] REQUEST_METHOD: `POST` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:30:26.925308 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4a983f-3823-496e-b1af-cd4ce3139c33 admin admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:30:26.925577 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4a983f-3823-496e-b1af-cd4ce3139c33 admin admin] PATH_INFO: `/v3/users` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:30:26.926315 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4a983f-3823-496e-b1af-cd4ce3139c33 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:30:26.927306 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: WARNING py.warnings [None req-3d4a983f-3823-496e-b1af-cd4ce3139c33 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 24 19:30:26.927306 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: warnings.warn(msg) Sep 24 19:30:26.927306 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: Sep 24 19:30:26.928527 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4a983f-3823-496e-b1af-cd4ce3139c33 admin admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:30:26.952661 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 555/1115] 10.222.0.18 () {60 vars in 1144 bytes} [Sat Sep 24 19:30:26 2022] POST /identity/v3/users => generated 290 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:30:26.958396 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf70731-00c3-4274-87df-86c189791870 admin admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:30:26.973575 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf70731-00c3-4274-87df-86c189791870 admin admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:30:26.980097 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2e3d58-8b83-4dda-b25e-e6b11da46155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fc67bd325c24a418945f738b4bd5c71', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:30:26.980097 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2e3d58-8b83-4dda-b25e-e6b11da46155 admin admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:30:26.980097 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2e3d58-8b83-4dda-b25e-e6b11da46155 admin admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:30:26.980461 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2e3d58-8b83-4dda-b25e-e6b11da46155 admin admin] PATH_INFO: `/v3/roles` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:30:26.981001 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2e3d58-8b83-4dda-b25e-e6b11da46155 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:30:26.982039 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: WARNING py.warnings [None req-4f2e3d58-8b83-4dda-b25e-e6b11da46155 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 24 19:30:26.982039 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: warnings.warn(msg) Sep 24 19:30:26.982039 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: Sep 24 19:30:26.982926 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2e3d58-8b83-4dda-b25e-e6b11da46155 admin admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:30:26.997471 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 561/1116] 10.222.0.18 () {58 vars in 1122 bytes} [Sat Sep 24 19:30:26 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 19:30:27.002082 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4a983f-3823-496e-b1af-cd4ce3139c33 admin admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:30:27.012212 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4a983f-3823-496e-b1af-cd4ce3139c33 admin admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:30:27.016907 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35433204-a482-4c84-be98-a7aebe3921ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fc67bd325c24a418945f738b4bd5c71', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:30:27.017553 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35433204-a482-4c84-be98-a7aebe3921ee admin admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:30:27.017851 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35433204-a482-4c84-be98-a7aebe3921ee admin admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:30:27.018146 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35433204-a482-4c84-be98-a7aebe3921ee admin admin] PATH_INFO: `/v3/roles` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:30:27.018788 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35433204-a482-4c84-be98-a7aebe3921ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:30:27.019792 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: WARNING py.warnings [None req-35433204-a482-4c84-be98-a7aebe3921ee admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 24 19:30:27.019792 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: warnings.warn(msg) Sep 24 19:30:27.019792 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: Sep 24 19:30:27.020667 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35433204-a482-4c84-be98-a7aebe3921ee admin admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:30:27.034670 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 556/1117] 10.222.0.18 () {58 vars in 1122 bytes} [Sat Sep 24 19:30:27 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 24 19:30:27.039411 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2e3d58-8b83-4dda-b25e-e6b11da46155 admin admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:30:27.049523 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2e3d58-8b83-4dda-b25e-e6b11da46155 admin admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:30:27.054824 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cd3fda-0e6a-4d65-9060-277d1c8f76d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fc67bd325c24a418945f738b4bd5c71', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:30:27.055473 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cd3fda-0e6a-4d65-9060-277d1c8f76d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:30:27.055748 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cd3fda-0e6a-4d65-9060-277d1c8f76d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:30:27.056015 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cd3fda-0e6a-4d65-9060-277d1c8f76d1 admin admin] PATH_INFO: `/v3/projects/b817974600ba4c3bb618e58d3594b570/users/51872097351c41ac82f3ac16ec4e94b1/roles/3a42524fc57c4487a34c5c05234413a7` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:30:27.076421 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cd3fda-0e6a-4d65-9060-277d1c8f76d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b817974600ba4c3bb618e58d3594b570, user_id=51872097351c41ac82f3ac16ec4e94b1, role_id=3a42524fc57c4487a34c5c05234413a7)` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:30:27.077437 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: WARNING py.warnings [None req-70cd3fda-0e6a-4d65-9060-277d1c8f76d1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 24 19:30:27.077437 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: warnings.warn(msg) Sep 24 19:30:27.077437 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: Sep 24 19:30:27.079372 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cd3fda-0e6a-4d65-9060-277d1c8f76d1 admin admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:30:27.093557 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 562/1118] 10.222.0.18 () {60 vars in 1483 bytes} [Sat Sep 24 19:30:27 2022] PUT /identity/v3/projects/b817974600ba4c3bb618e58d3594b570/users/51872097351c41ac82f3ac16ec4e94b1/roles/3a42524fc57c4487a34c5c05234413a7 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:30:27.107285 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a469b0-2ff6-41c1-af74-6971abccb6df None None] REQUEST_METHOD: `POST` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:30:27.107564 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a469b0-2ff6-41c1-af74-6971abccb6df None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:30:27.107833 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a469b0-2ff6-41c1-af74-6971abccb6df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:30:27.137129 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.auth.core [None req-19a469b0-2ff6-41c1-af74-6971abccb6df None None] MFA Rules not processed for user `51872097351c41ac82f3ac16ec4e94b1`. Rule list: `[]` (Enabled: `True`). {{(pid=88081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:30:27.138415 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.fernet_utils [None req-19a469b0-2ff6-41c1-af74-6971abccb6df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:30:27.171595 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:30:27.205451 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 557/1119] 10.222.0.18 () {58 vars in 958 bytes} [Sat Sep 24 19:30:27 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:30:27.219323 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9503b534-27bb-4695-94cf-68ee678ba961 None None] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:30:27.219600 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9503b534-27bb-4695-94cf-68ee678ba961 None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:30:27.219868 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9503b534-27bb-4695-94cf-68ee678ba961 None None] PATH_INFO: `/` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:30:27.221188 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 563/1120] 10.222.0.18 () {54 vars in 963 bytes} [Sat Sep 24 19:30:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:30:27.226683 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1003b3-abc8-43a2-a175-afdc45509546 None None] REQUEST_METHOD: `POST` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:30:27.226970 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1003b3-abc8-43a2-a175-afdc45509546 None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:30:27.227225 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1003b3-abc8-43a2-a175-afdc45509546 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:30:27.250336 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.auth.core [None req-ae1003b3-abc8-43a2-a175-afdc45509546 None None] MFA Rules not processed for user `cd2db56b901e4fb08a0ec849cc9136f9`. Rule list: `[]` (Enabled: `True`). {{(pid=88081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:30:27.251529 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.fernet_utils [None req-ae1003b3-abc8-43a2-a175-afdc45509546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:30:27.319964 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 558/1121] 10.222.0.18 () {58 vars in 1060 bytes} [Sat Sep 24 19:30:27 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:30:27.327692 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9503b534-27bb-4695-94cf-68ee678ba961 None None] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:30:27.339271 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9503b534-27bb-4695-94cf-68ee678ba961 None None] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:30:27.342873 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bc3415-49b1-4368-9968-3bec4f93b42b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd2db56b901e4fb08a0ec849cc9136f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dfa5c2c17244006bdd629ec81553f1a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:30:27.343499 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bc3415-49b1-4368-9968-3bec4f93b42b service cinder] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:30:27.343775 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bc3415-49b1-4368-9968-3bec4f93b42b service cinder] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:30:27.344049 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bc3415-49b1-4368-9968-3bec4f93b42b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:30:27.353543 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bc3415-49b1-4368-9968-3bec4f93b42b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:30:27.355010 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bc3415-49b1-4368-9968-3bec4f93b42b service cinder] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:30:27.364527 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 564/1122] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Sep 24 19:30:27 2022] GET /identity/v3/auth/tokens => generated 2816 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:30:27.405631 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d21fc4-412e-4951-9107-386f0c2eab51 None None] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:30:27.406018 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d21fc4-412e-4951-9107-386f0c2eab51 None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:30:27.406377 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d21fc4-412e-4951-9107-386f0c2eab51 None None] PATH_INFO: `/` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:30:27.407661 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 559/1123] 10.222.0.18 () {52 vars in 830 bytes} [Sat Sep 24 19:30:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:30:27.411258 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bc3415-49b1-4368-9968-3bec4f93b42b service cinder] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:30:27.476018 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bc3415-49b1-4368-9968-3bec4f93b42b service cinder] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:30:27.480638 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd67fcf-68c1-4675-a8a6-bb9ac539f0dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fc67bd325c24a418945f738b4bd5c71', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:30:27.481270 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd67fcf-68c1-4675-a8a6-bb9ac539f0dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:30:27.481685 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd67fcf-68c1-4675-a8a6-bb9ac539f0dd admin admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:30:27.481894 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd67fcf-68c1-4675-a8a6-bb9ac539f0dd admin admin] PATH_INFO: `/v3/users/51872097351c41ac82f3ac16ec4e94b1` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:30:27.482959 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd67fcf-68c1-4675-a8a6-bb9ac539f0dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=51872097351c41ac82f3ac16ec4e94b1)` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:30:27.483970 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: WARNING py.warnings [None req-ccd67fcf-68c1-4675-a8a6-bb9ac539f0dd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 24 19:30:27.483970 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: warnings.warn(msg) Sep 24 19:30:27.483970 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: Sep 24 19:30:27.485170 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd67fcf-68c1-4675-a8a6-bb9ac539f0dd admin admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:30:27.562470 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.notifications [None req-ccd67fcf-68c1-4675-a8a6-bb9ac539f0dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51872097351c41ac82f3ac16ec4e94b1'} {{(pid=88080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:30:27.563184 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.notifications [None req-ccd67fcf-68c1-4675-a8a6-bb9ac539f0dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51872097351c41ac82f3ac16ec4e94b1'} {{(pid=88080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:30:27.579923 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.notifications [None req-ccd67fcf-68c1-4675-a8a6-bb9ac539f0dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51872097351c41ac82f3ac16ec4e94b1'} {{(pid=88080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:30:27.580697 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.notifications [None req-ccd67fcf-68c1-4675-a8a6-bb9ac539f0dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51872097351c41ac82f3ac16ec4e94b1'} {{(pid=88080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:30:27.594463 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.notifications [None req-ccd67fcf-68c1-4675-a8a6-bb9ac539f0dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51872097351c41ac82f3ac16ec4e94b1'} {{(pid=88080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:30:27.621607 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:30:27.631768 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 565/1124] 10.222.0.18 () {58 vars in 1224 bytes} [Sat Sep 24 19:30:27 2022] DELETE /identity/v3/users/51872097351c41ac82f3ac16ec4e94b1 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:30:27.636616 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f0f99c-b141-4fe0-af18-b50c0419d0ef None None] REQUEST_METHOD: `POST` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:30:27.637188 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f0f99c-b141-4fe0-af18-b50c0419d0ef None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:30:27.637504 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f0f99c-b141-4fe0-af18-b50c0419d0ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:30:27.658677 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.auth.core [None req-f1f0f99c-b141-4fe0-af18-b50c0419d0ef None None] MFA Rules not processed for user `3dbbb9909cec43ff99c1c3682f016ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=88081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:30:27.659880 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.fernet_utils [None req-f1f0f99c-b141-4fe0-af18-b50c0419d0ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:30:27.726713 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 560/1125] 10.222.0.18 () {58 vars in 958 bytes} [Sat Sep 24 19:30:27 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:30:27.736201 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd67fcf-68c1-4675-a8a6-bb9ac539f0dd admin admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:30:27.737714 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.fernet_utils [None req-ccd67fcf-68c1-4675-a8a6-bb9ac539f0dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:30:27.798189 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd67fcf-68c1-4675-a8a6-bb9ac539f0dd admin admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:30:27.801989 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84dac7c-5819-433b-bccc-b21a0577c088 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ef291c173794b49ade9469a5ef72e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dfa5c2c17244006bdd629ec81553f1a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:30:27.802624 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84dac7c-5819-433b-bccc-b21a0577c088 service neutron] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:30:27.802902 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84dac7c-5819-433b-bccc-b21a0577c088 service neutron] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:30:27.803199 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84dac7c-5819-433b-bccc-b21a0577c088 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:30:27.813181 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84dac7c-5819-433b-bccc-b21a0577c088 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:30:27.814649 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84dac7c-5819-433b-bccc-b21a0577c088 service neutron] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:30:27.824151 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 566/1126] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Sep 24 19:30:27 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:30:28.230896 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f0f99c-b141-4fe0-af18-b50c0419d0ef None None] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:30:28.232353 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.fernet_utils [None req-f1f0f99c-b141-4fe0-af18-b50c0419d0ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:30:28.245388 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f0f99c-b141-4fe0-af18-b50c0419d0ef None None] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:30:28.250602 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7710a51-16d1-43ae-80f4-40081cf2def6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fc67bd325c24a418945f738b4bd5c71', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:30:28.251305 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7710a51-16d1-43ae-80f4-40081cf2def6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:30:28.251515 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7710a51-16d1-43ae-80f4-40081cf2def6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:30:28.251791 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7710a51-16d1-43ae-80f4-40081cf2def6 admin admin] PATH_INFO: `/v3/projects/b817974600ba4c3bb618e58d3594b570` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:30:28.252928 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7710a51-16d1-43ae-80f4-40081cf2def6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b817974600ba4c3bb618e58d3594b570)` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:30:28.254012 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: WARNING py.warnings [None req-d7710a51-16d1-43ae-80f4-40081cf2def6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 24 19:30:28.254012 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: warnings.warn(msg) Sep 24 19:30:28.254012 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: Sep 24 19:30:28.255131 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7710a51-16d1-43ae-80f4-40081cf2def6 admin admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:30:28.333208 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.notifications [None req-d7710a51-16d1-43ae-80f4-40081cf2def6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b817974600ba4c3bb618e58d3594b570', 'request_id': 'req-d7710a51-16d1-43ae-80f4-40081cf2def6'} {{(pid=88081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:30:28.346870 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.notifications [None req-d7710a51-16d1-43ae-80f4-40081cf2def6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b817974600ba4c3bb618e58d3594b570', 'request_id': 'req-d7710a51-16d1-43ae-80f4-40081cf2def6'} {{(pid=88081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:30:28.364768 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.notifications [None req-d7710a51-16d1-43ae-80f4-40081cf2def6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b817974600ba4c3bb618e58d3594b570', 'request_id': 'req-d7710a51-16d1-43ae-80f4-40081cf2def6'} {{(pid=88081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:30:28.399281 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.notifications [None req-d7710a51-16d1-43ae-80f4-40081cf2def6 admin admin] The token cache is being invalidate because project b817974600ba4c3bb618e58d3594b570 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88081) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 19:30:28.399828 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.notifications [None req-d7710a51-16d1-43ae-80f4-40081cf2def6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:30:28.401039 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.notifications [None req-d7710a51-16d1-43ae-80f4-40081cf2def6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:30:28.403617 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 561/1127] 10.222.0.18 () {58 vars in 1233 bytes} [Sat Sep 24 19:30:28 2022] DELETE /identity/v3/projects/b817974600ba4c3bb618e58d3594b570 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:30:37.820144 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:DELETE=1,keystone:SELECT=28 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:30:38.393420 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:31:50.725391 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ecf935-5f65-4e25-9ee3-02a15b19634f None None] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:31:50.726030 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ecf935-5f65-4e25-9ee3-02a15b19634f None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:31:50.726130 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ecf935-5f65-4e25-9ee3-02a15b19634f None None] PATH_INFO: `/` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:31:50.727465 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 567/1128] 127.0.0.1 () {54 vars in 901 bytes} [Sat Sep 24 19:31:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:31:50.733068 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085f36cd-d05a-4b1f-a31d-b85c2f4790df None None] REQUEST_METHOD: `POST` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:31:50.733681 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085f36cd-d05a-4b1f-a31d-b85c2f4790df None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:31:50.733681 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085f36cd-d05a-4b1f-a31d-b85c2f4790df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:31:50.754806 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.auth.core [None req-085f36cd-d05a-4b1f-a31d-b85c2f4790df None None] MFA Rules not processed for user `3dbbb9909cec43ff99c1c3682f016ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=88081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:31:50.756531 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.fernet_utils [None req-085f36cd-d05a-4b1f-a31d-b85c2f4790df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:31:50.818709 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 562/1129] 127.0.0.1 () {58 vars in 998 bytes} [Sat Sep 24 19:31:50 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:31:50.991825 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ecf935-5f65-4e25-9ee3-02a15b19634f None None] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:31:50.993576 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.fernet_utils [None req-08ecf935-5f65-4e25-9ee3-02a15b19634f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:31:51.084528 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ecf935-5f65-4e25-9ee3-02a15b19634f None None] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:31:51.089641 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbd22b3-ef38-445d-b2e5-d71931fced8c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ab73abe1c6e4b25a17281f4cd8e97e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dfa5c2c17244006bdd629ec81553f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:31:51.090277 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbd22b3-ef38-445d-b2e5-d71931fced8c service nova] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:31:51.090553 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbd22b3-ef38-445d-b2e5-d71931fced8c service nova] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:31:51.090824 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbd22b3-ef38-445d-b2e5-d71931fced8c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:31:51.099761 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbd22b3-ef38-445d-b2e5-d71931fced8c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:31:51.101452 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbd22b3-ef38-445d-b2e5-d71931fced8c service nova] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:31:51.110915 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 568/1130] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Sep 24 19:31:50 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:31:52.761121 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0338bd6-17b7-4084-96af-5b88e168a42d None None] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:31:52.761502 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0338bd6-17b7-4084-96af-5b88e168a42d None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:31:52.761618 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0338bd6-17b7-4084-96af-5b88e168a42d None None] PATH_INFO: `/` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:31:52.762975 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 563/1131] 127.0.0.1 () {54 vars in 901 bytes} [Sat Sep 24 19:31:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:31:52.767955 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4835a859-ddb0-4033-8d93-c3cf5f631ea9 None None] REQUEST_METHOD: `POST` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:31:52.768448 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4835a859-ddb0-4033-8d93-c3cf5f631ea9 None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:31:52.768548 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4835a859-ddb0-4033-8d93-c3cf5f631ea9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:31:52.789484 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.auth.core [None req-4835a859-ddb0-4033-8d93-c3cf5f631ea9 None None] MFA Rules not processed for user `3dbbb9909cec43ff99c1c3682f016ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=88080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:31:52.790712 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.fernet_utils [None req-4835a859-ddb0-4033-8d93-c3cf5f631ea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:31:52.798481 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 569/1132] 127.0.0.1 () {58 vars in 998 bytes} [Sat Sep 24 19:31:52 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:31:52.969572 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0338bd6-17b7-4084-96af-5b88e168a42d None None] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:31:52.984335 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0338bd6-17b7-4084-96af-5b88e168a42d None None] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:31:52.989583 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0332ed32-37d3-432f-b510-2e724246ed9e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ab73abe1c6e4b25a17281f4cd8e97e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dfa5c2c17244006bdd629ec81553f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:31:52.990246 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0332ed32-37d3-432f-b510-2e724246ed9e service nova] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:31:52.990529 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0332ed32-37d3-432f-b510-2e724246ed9e service nova] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:31:52.990806 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0332ed32-37d3-432f-b510-2e724246ed9e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:31:53.001361 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0332ed32-37d3-432f-b510-2e724246ed9e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:31:53.003000 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0332ed32-37d3-432f-b510-2e724246ed9e service nova] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:31:53.015110 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 564/1133] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Sep 24 19:31:52 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:31:55.976054 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf06620-db88-48ba-8ef2-03d71f447174 None None] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:31:55.976624 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf06620-db88-48ba-8ef2-03d71f447174 None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:31:55.976624 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf06620-db88-48ba-8ef2-03d71f447174 None None] PATH_INFO: `/v3` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:31:55.977804 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 570/1134] 10.222.0.26 () {54 vars in 925 bytes} [Sat Sep 24 19:31:55 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 19:31:55.983814 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfb98cb-c644-4b8a-8ce7-fcca948da773 None None] REQUEST_METHOD: `POST` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:31:55.984387 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfb98cb-c644-4b8a-8ce7-fcca948da773 None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:31:55.984387 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfb98cb-c644-4b8a-8ce7-fcca948da773 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:31:56.018328 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.auth.core [None req-8cfb98cb-c644-4b8a-8ce7-fcca948da773 None None] MFA Rules not processed for user `f2dfc6ff4e9b4d30b28d39d678b19896`. Rule list: `[]` (Enabled: `True`). {{(pid=88081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:31:56.022782 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.fernet_utils [None req-8cfb98cb-c644-4b8a-8ce7-fcca948da773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:31:56.111169 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 565/1135] 10.222.0.26 () {58 vars in 1015 bytes} [Sat Sep 24 19:31:55 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 19:31:59.863082 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07c7d71-f363-4a61-8fc6-553748205859 None None] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:31:59.863971 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07c7d71-f363-4a61-8fc6-553748205859 None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:31:59.863971 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07c7d71-f363-4a61-8fc6-553748205859 None None] PATH_INFO: `/` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:31:59.865036 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 571/1136] 10.222.0.18 () {54 vars in 961 bytes} [Sat Sep 24 19:31:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:31:59.871785 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dcd6b9-cfc3-4571-b3ed-0040395344e5 None None] REQUEST_METHOD: `POST` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:31:59.872359 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dcd6b9-cfc3-4571-b3ed-0040395344e5 None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:31:59.872359 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dcd6b9-cfc3-4571-b3ed-0040395344e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:31:59.896047 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.auth.core [None req-a4dcd6b9-cfc3-4571-b3ed-0040395344e5 None None] MFA Rules not processed for user `f2dfc6ff4e9b4d30b28d39d678b19896`. Rule list: `[]` (Enabled: `True`). {{(pid=88081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:31:59.897285 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.fernet_utils [None req-a4dcd6b9-cfc3-4571-b3ed-0040395344e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:31:59.906009 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 566/1137] 10.222.0.18 () {58 vars in 1058 bytes} [Sat Sep 24 19:31:59 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 19:31:59.914158 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07c7d71-f363-4a61-8fc6-553748205859 None None] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:31:59.929738 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07c7d71-f363-4a61-8fc6-553748205859 None None] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:31:59.936345 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45f3a66-625b-46c2-9635-d934f4f24dcd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2dfc6ff4e9b4d30b28d39d678b19896', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dfa5c2c17244006bdd629ec81553f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:31:59.937095 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45f3a66-625b-46c2-9635-d934f4f24dcd service placement] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:31:59.937465 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45f3a66-625b-46c2-9635-d934f4f24dcd service placement] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:31:59.937858 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45f3a66-625b-46c2-9635-d934f4f24dcd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:31:59.948172 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45f3a66-625b-46c2-9635-d934f4f24dcd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:31:59.949813 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45f3a66-625b-46c2-9635-d934f4f24dcd service placement] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:31:59.961811 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 572/1138] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Sep 24 19:31:59 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:32:05.191916 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40079f15-f17e-4fad-9007-1392cf541f1c None None] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:32:05.192559 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40079f15-f17e-4fad-9007-1392cf541f1c None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:32:05.192559 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40079f15-f17e-4fad-9007-1392cf541f1c None None] PATH_INFO: `/` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:32:05.194067 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 567/1139] 127.0.0.1 () {54 vars in 901 bytes} [Sat Sep 24 19:32:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:32:05.199814 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f15fb9-6c5a-49c0-b87c-b2699ee9c412 None None] REQUEST_METHOD: `POST` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:32:05.200394 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f15fb9-6c5a-49c0-b87c-b2699ee9c412 None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:32:05.200394 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f15fb9-6c5a-49c0-b87c-b2699ee9c412 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:32:05.221913 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.auth.core [None req-69f15fb9-6c5a-49c0-b87c-b2699ee9c412 None None] MFA Rules not processed for user `3dbbb9909cec43ff99c1c3682f016ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=88080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:32:05.223829 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.fernet_utils [None req-69f15fb9-6c5a-49c0-b87c-b2699ee9c412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:32:05.232899 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 573/1140] 127.0.0.1 () {58 vars in 998 bytes} [Sat Sep 24 19:32:05 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 19:32:05.403158 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40079f15-f17e-4fad-9007-1392cf541f1c None None] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:32:05.418437 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40079f15-f17e-4fad-9007-1392cf541f1c None None] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:32:05.423464 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506c56b5-9b42-4b36-a561-074cfcf5caba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ab73abe1c6e4b25a17281f4cd8e97e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dfa5c2c17244006bdd629ec81553f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:32:05.424074 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506c56b5-9b42-4b36-a561-074cfcf5caba service nova] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:32:05.424349 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506c56b5-9b42-4b36-a561-074cfcf5caba service nova] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:32:05.424617 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506c56b5-9b42-4b36-a561-074cfcf5caba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:32:05.434037 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506c56b5-9b42-4b36-a561-074cfcf5caba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:32:05.435669 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506c56b5-9b42-4b36-a561-074cfcf5caba service nova] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:32:05.446584 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 568/1141] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Sep 24 19:32:05 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:32:07.242716 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2c3124-708e-471a-ba17-5feaab7a3cab None None] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:32:07.243280 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2c3124-708e-471a-ba17-5feaab7a3cab None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:32:07.243374 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2c3124-708e-471a-ba17-5feaab7a3cab None None] PATH_INFO: `/` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:32:07.245078 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 574/1142] 127.0.0.1 () {54 vars in 901 bytes} [Sat Sep 24 19:32:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:32:07.251203 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81191bdf-5446-4d55-b5e5-04ae302ad70d None None] REQUEST_METHOD: `POST` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:32:07.251786 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81191bdf-5446-4d55-b5e5-04ae302ad70d None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:32:07.251910 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81191bdf-5446-4d55-b5e5-04ae302ad70d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:32:07.275902 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.auth.core [None req-81191bdf-5446-4d55-b5e5-04ae302ad70d None None] MFA Rules not processed for user `3dbbb9909cec43ff99c1c3682f016ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=88081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:32:07.277297 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.fernet_utils [None req-81191bdf-5446-4d55-b5e5-04ae302ad70d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:32:07.287283 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 569/1143] 127.0.0.1 () {58 vars in 998 bytes} [Sat Sep 24 19:32:07 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 19:32:07.543463 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2c3124-708e-471a-ba17-5feaab7a3cab None None] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:32:07.558272 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2c3124-708e-471a-ba17-5feaab7a3cab None None] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:32:07.563429 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a238bdd6-cac8-40af-b4f3-120fca516f0e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ab73abe1c6e4b25a17281f4cd8e97e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dfa5c2c17244006bdd629ec81553f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:32:07.564047 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a238bdd6-cac8-40af-b4f3-120fca516f0e service nova] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:32:07.564320 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a238bdd6-cac8-40af-b4f3-120fca516f0e service nova] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:32:07.564586 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a238bdd6-cac8-40af-b4f3-120fca516f0e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:32:07.574399 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a238bdd6-cac8-40af-b4f3-120fca516f0e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:32:07.576011 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a238bdd6-cac8-40af-b4f3-120fca516f0e service nova] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:32:07.587364 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 575/1144] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Sep 24 19:32:07 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:32:12.279915 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b94d7ad-634e-4591-96dd-1c9935f06514 None None] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:32:12.280519 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b94d7ad-634e-4591-96dd-1c9935f06514 None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:32:12.280519 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b94d7ad-634e-4591-96dd-1c9935f06514 None None] PATH_INFO: `/` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:32:12.281938 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 570/1145] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 24 19:32:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 24 19:32:12.289871 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a21df5a-ea54-4dd3-8079-0c3d0bcee28d None None] REQUEST_METHOD: `POST` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:32:12.290432 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a21df5a-ea54-4dd3-8079-0c3d0bcee28d None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:32:12.290432 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a21df5a-ea54-4dd3-8079-0c3d0bcee28d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:32:12.314149 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.auth.core [None req-7a21df5a-ea54-4dd3-8079-0c3d0bcee28d None None] MFA Rules not processed for user `3dbbb9909cec43ff99c1c3682f016ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=88080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:32:12.315400 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.fernet_utils [None req-7a21df5a-ea54-4dd3-8079-0c3d0bcee28d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:32:12.323703 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 576/1146] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 24 19:32:12 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:32:12.835428 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b94d7ad-634e-4591-96dd-1c9935f06514 None None] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:32:12.838201 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.fernet_utils [None req-6b94d7ad-634e-4591-96dd-1c9935f06514 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:32:12.929200 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:32:12.948094 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b94d7ad-634e-4591-96dd-1c9935f06514 None None] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:32:12.951814 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41f4583-e576-448d-bf4d-7b684b7b9731 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ef291c173794b49ade9469a5ef72e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dfa5c2c17244006bdd629ec81553f1a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:32:12.952438 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41f4583-e576-448d-bf4d-7b684b7b9731 service neutron] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:32:12.952719 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41f4583-e576-448d-bf4d-7b684b7b9731 service neutron] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:32:12.952993 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41f4583-e576-448d-bf4d-7b684b7b9731 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:32:12.963782 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41f4583-e576-448d-bf4d-7b684b7b9731 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:32:12.965309 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41f4583-e576-448d-bf4d-7b684b7b9731 service neutron] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:32:12.976832 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 571/1147] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Sep 24 19:32:12 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:32:15.535996 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287fec60-c13c-439d-9ae6-7307b2fdbd90 None None] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:32:15.536596 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287fec60-c13c-439d-9ae6-7307b2fdbd90 None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:32:15.536596 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287fec60-c13c-439d-9ae6-7307b2fdbd90 None None] PATH_INFO: `/` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:32:15.538802 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 577/1148] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 24 19:32:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:32:15.545933 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658f4cbb-5e50-453b-8c34-fb594f45ea56 None None] REQUEST_METHOD: `POST` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:32:15.546507 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658f4cbb-5e50-453b-8c34-fb594f45ea56 None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:32:15.546787 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658f4cbb-5e50-453b-8c34-fb594f45ea56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:32:15.572128 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.auth.core [None req-658f4cbb-5e50-453b-8c34-fb594f45ea56 None None] MFA Rules not processed for user `3dbbb9909cec43ff99c1c3682f016ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=88081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:32:15.573357 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.fernet_utils [None req-658f4cbb-5e50-453b-8c34-fb594f45ea56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:32:15.581433 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 572/1149] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 24 19:32:15 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:32:15.927597 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287fec60-c13c-439d-9ae6-7307b2fdbd90 None None] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:32:15.939786 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287fec60-c13c-439d-9ae6-7307b2fdbd90 None None] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:32:15.943805 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80d306f-6ec4-418d-a519-1fc237ffcfe4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ef291c173794b49ade9469a5ef72e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dfa5c2c17244006bdd629ec81553f1a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:32:15.944463 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80d306f-6ec4-418d-a519-1fc237ffcfe4 service neutron] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:32:15.944786 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80d306f-6ec4-418d-a519-1fc237ffcfe4 service neutron] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:32:15.945103 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80d306f-6ec4-418d-a519-1fc237ffcfe4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:32:15.955290 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80d306f-6ec4-418d-a519-1fc237ffcfe4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:32:15.956734 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80d306f-6ec4-418d-a519-1fc237ffcfe4 service neutron] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:32:15.967575 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 578/1150] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Sep 24 19:32:15 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:32:20.408355 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d9026d-b94f-4513-95b9-85959db9978c None None] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:32:20.409020 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d9026d-b94f-4513-95b9-85959db9978c None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:32:20.409020 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d9026d-b94f-4513-95b9-85959db9978c None None] PATH_INFO: `/` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:32:20.410788 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 573/1151] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 24 19:32:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:32:20.416340 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b66e71a-c8e1-4953-a4a9-e59a34e5e0d7 None None] REQUEST_METHOD: `POST` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:32:20.416951 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b66e71a-c8e1-4953-a4a9-e59a34e5e0d7 None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:32:20.416951 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b66e71a-c8e1-4953-a4a9-e59a34e5e0d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:32:20.424947 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=67 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:32:20.438508 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.auth.core [None req-2b66e71a-c8e1-4953-a4a9-e59a34e5e0d7 None None] MFA Rules not processed for user `3dbbb9909cec43ff99c1c3682f016ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=88080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:32:20.439717 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.fernet_utils [None req-2b66e71a-c8e1-4953-a4a9-e59a34e5e0d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:32:20.447853 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 579/1152] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 24 19:32:20 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:32:20.807721 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d9026d-b94f-4513-95b9-85959db9978c None None] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:32:20.810315 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.fernet_utils [None req-f1d9026d-b94f-4513-95b9-85959db9978c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:32:20.897633 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d9026d-b94f-4513-95b9-85959db9978c None None] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:32:20.901666 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3b7631-f8eb-49bc-8ae3-390befd9d378 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd2db56b901e4fb08a0ec849cc9136f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dfa5c2c17244006bdd629ec81553f1a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:32:20.902316 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3b7631-f8eb-49bc-8ae3-390befd9d378 service cinder] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:32:20.902621 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3b7631-f8eb-49bc-8ae3-390befd9d378 service cinder] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:32:20.902892 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3b7631-f8eb-49bc-8ae3-390befd9d378 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:32:20.913214 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3b7631-f8eb-49bc-8ae3-390befd9d378 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:32:20.914684 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3b7631-f8eb-49bc-8ae3-390befd9d378 service cinder] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:32:20.924767 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 574/1153] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Sep 24 19:32:20 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:32:23.467516 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fe84a4-4b79-40f9-9a1b-bb8eb6cf3ef9 None None] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:32:23.468165 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fe84a4-4b79-40f9-9a1b-bb8eb6cf3ef9 None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:32:23.468165 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fe84a4-4b79-40f9-9a1b-bb8eb6cf3ef9 None None] PATH_INFO: `/` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:32:23.469452 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 580/1154] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 24 19:32:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:32:23.476012 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e628749-7ab1-4473-9214-47ecd7eb70b3 None None] REQUEST_METHOD: `POST` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:32:23.476852 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e628749-7ab1-4473-9214-47ecd7eb70b3 None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:32:23.476852 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e628749-7ab1-4473-9214-47ecd7eb70b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:32:23.498853 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.auth.core [None req-9e628749-7ab1-4473-9214-47ecd7eb70b3 None None] MFA Rules not processed for user `3dbbb9909cec43ff99c1c3682f016ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=88081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:32:23.500087 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.fernet_utils [None req-9e628749-7ab1-4473-9214-47ecd7eb70b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:32:23.508120 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 575/1155] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 24 19:32:23 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:32:23.866109 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fe84a4-4b79-40f9-9a1b-bb8eb6cf3ef9 None None] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:32:23.868321 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.fernet_utils [None req-11fe84a4-4b79-40f9-9a1b-bb8eb6cf3ef9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:32:23.882364 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fe84a4-4b79-40f9-9a1b-bb8eb6cf3ef9 None None] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:32:23.886115 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d45461-64e5-4b6d-96bc-2509abd9dc23 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd2db56b901e4fb08a0ec849cc9136f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dfa5c2c17244006bdd629ec81553f1a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:32:23.886724 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d45461-64e5-4b6d-96bc-2509abd9dc23 service cinder] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:32:23.887001 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d45461-64e5-4b6d-96bc-2509abd9dc23 service cinder] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:32:23.887270 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d45461-64e5-4b6d-96bc-2509abd9dc23 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:32:23.897455 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d45461-64e5-4b6d-96bc-2509abd9dc23 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:32:23.898929 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d45461-64e5-4b6d-96bc-2509abd9dc23 service cinder] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:32:23.908690 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 581/1156] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Sep 24 19:32:23 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:32:33.492912 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=46 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:32:33.904316 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=8 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:33:39.602419 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8bc738-bb3e-472b-b687-3dca1e196e67 None None] REQUEST_METHOD: `POST` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:33:39.603225 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8bc738-bb3e-472b-b687-3dca1e196e67 None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:33:39.603225 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8bc738-bb3e-472b-b687-3dca1e196e67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:33:39.621625 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d2f571-9332-4cef-84ae-7a49f0a004bb None None] REQUEST_METHOD: `POST` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:33:39.622235 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d2f571-9332-4cef-84ae-7a49f0a004bb None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:33:39.622235 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d2f571-9332-4cef-84ae-7a49f0a004bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:33:39.623002 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.auth.core [None req-6e8bc738-bb3e-472b-b687-3dca1e196e67 None None] MFA Rules not processed for user `3dbbb9909cec43ff99c1c3682f016ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=88081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:33:39.624229 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.fernet_utils [None req-6e8bc738-bb3e-472b-b687-3dca1e196e67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:33:39.631970 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 576/1157] 10.222.0.18 () {58 vars in 958 bytes} [Sat Sep 24 19:33:39 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:33:39.640300 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b7cc84-a7ff-41d4-a613-71dd187b93db None None] REQUEST_METHOD: `POST` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:33:39.640647 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b7cc84-a7ff-41d4-a613-71dd187b93db None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:33:39.640845 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b7cc84-a7ff-41d4-a613-71dd187b93db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:33:39.641647 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.auth.core [None req-51d2f571-9332-4cef-84ae-7a49f0a004bb None None] MFA Rules not processed for user `3dbbb9909cec43ff99c1c3682f016ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=88080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:33:39.642878 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.fernet_utils [None req-51d2f571-9332-4cef-84ae-7a49f0a004bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:33:39.651312 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 582/1158] 10.222.0.18 () {58 vars in 958 bytes} [Sat Sep 24 19:33:39 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 19:33:39.659307 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e9d187-6c99-4d67-b5ec-eac0f486be74 None None] REQUEST_METHOD: `POST` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:33:39.659590 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e9d187-6c99-4d67-b5ec-eac0f486be74 None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:33:39.659870 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e9d187-6c99-4d67-b5ec-eac0f486be74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:33:39.661010 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.auth.core [None req-92b7cc84-a7ff-41d4-a613-71dd187b93db None None] MFA Rules not processed for user `3dbbb9909cec43ff99c1c3682f016ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=88081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:33:39.662211 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.fernet_utils [None req-92b7cc84-a7ff-41d4-a613-71dd187b93db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:33:39.669855 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 577/1159] 10.222.0.18 () {58 vars in 958 bytes} [Sat Sep 24 19:33:39 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 19:33:39.674336 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b7cc84-a7ff-41d4-a613-71dd187b93db None None] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:33:39.679653 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.auth.core [None req-d1e9d187-6c99-4d67-b5ec-eac0f486be74 None None] MFA Rules not processed for user `3dbbb9909cec43ff99c1c3682f016ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=88080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:33:39.680824 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.fernet_utils [None req-d1e9d187-6c99-4d67-b5ec-eac0f486be74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:33:39.683383 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b7cc84-a7ff-41d4-a613-71dd187b93db None None] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:33:39.687830 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4356ea7-cbae-493c-b262-fdfdd962a2ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fc67bd325c24a418945f738b4bd5c71', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:33:39.688416 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4356ea7-cbae-493c-b262-fdfdd962a2ab admin admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:33:39.688548 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 583/1160] 10.222.0.18 () {58 vars in 958 bytes} [Sat Sep 24 19:33:39 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 19:33:39.688698 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4356ea7-cbae-493c-b262-fdfdd962a2ab admin admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:33:39.688941 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4356ea7-cbae-493c-b262-fdfdd962a2ab admin admin] PATH_INFO: `/v3/domains` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:33:39.689567 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4356ea7-cbae-493c-b262-fdfdd962a2ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88081) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:33:39.689902 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4356ea7-cbae-493c-b262-fdfdd962a2ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:33:39.691615 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4356ea7-cbae-493c-b262-fdfdd962a2ab admin admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:33:39.692892 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e9d187-6c99-4d67-b5ec-eac0f486be74 None None] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:33:39.701947 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e9d187-6c99-4d67-b5ec-eac0f486be74 None None] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:33:39.703319 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 578/1161] 10.222.0.18 () {58 vars in 1153 bytes} [Sat Sep 24 19:33:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:33:39.706686 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8dfd0e-49da-40af-b6e5-96b39d9b0480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fc67bd325c24a418945f738b4bd5c71', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:33:39.707788 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8dfd0e-49da-40af-b6e5-96b39d9b0480 admin admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:33:39.708066 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8dfd0e-49da-40af-b6e5-96b39d9b0480 admin admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:33:39.708336 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8dfd0e-49da-40af-b6e5-96b39d9b0480 admin admin] PATH_INFO: `/v3/domains` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:33:39.709124 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8dfd0e-49da-40af-b6e5-96b39d9b0480 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 19:33:39.709431 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8dfd0e-49da-40af-b6e5-96b39d9b0480 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:33:39.710580 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: WARNING py.warnings [None req-8d8dfd0e-49da-40af-b6e5-96b39d9b0480 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 24 19:33:39.710580 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: warnings.warn(msg) Sep 24 19:33:39.710580 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: Sep 24 19:33:39.711459 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8dfd0e-49da-40af-b6e5-96b39d9b0480 admin admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:33:39.711585 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4356ea7-cbae-493c-b262-fdfdd962a2ab admin admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:33:39.721219 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4356ea7-cbae-493c-b262-fdfdd962a2ab admin admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:33:39.724164 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 584/1162] 10.222.0.18 () {58 vars in 1153 bytes} [Sat Sep 24 19:33:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 19:33:39.726349 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0f6bfe-92a1-46b7-b2c4-4441ac0add11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fc67bd325c24a418945f738b4bd5c71', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:33:39.726934 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0f6bfe-92a1-46b7-b2c4-4441ac0add11 admin admin] REQUEST_METHOD: `POST` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:33:39.727209 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0f6bfe-92a1-46b7-b2c4-4441ac0add11 admin admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:33:39.727475 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0f6bfe-92a1-46b7-b2c4-4441ac0add11 admin admin] PATH_INFO: `/v3/projects` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:33:39.728099 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0f6bfe-92a1-46b7-b2c4-4441ac0add11 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:33:39.729084 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: WARNING py.warnings [None req-7b0f6bfe-92a1-46b7-b2c4-4441ac0add11 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 24 19:33:39.729084 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: warnings.warn(msg) Sep 24 19:33:39.729084 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: Sep 24 19:33:39.730294 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0f6bfe-92a1-46b7-b2c4-4441ac0add11 admin admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:33:39.731960 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8dfd0e-49da-40af-b6e5-96b39d9b0480 admin admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:33:39.742497 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8dfd0e-49da-40af-b6e5-96b39d9b0480 admin admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:33:39.747428 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da6a024-45d9-4bb2-ba31-2ff3ecae9164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fc67bd325c24a418945f738b4bd5c71', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:33:39.748026 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da6a024-45d9-4bb2-ba31-2ff3ecae9164 admin admin] REQUEST_METHOD: `POST` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:33:39.748325 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da6a024-45d9-4bb2-ba31-2ff3ecae9164 admin admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:33:39.748663 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da6a024-45d9-4bb2-ba31-2ff3ecae9164 admin admin] PATH_INFO: `/v3/projects` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:33:39.749294 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da6a024-45d9-4bb2-ba31-2ff3ecae9164 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:33:39.751356 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da6a024-45d9-4bb2-ba31-2ff3ecae9164 admin admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:33:39.762985 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 579/1163] 10.222.0.18 () {60 vars in 1153 bytes} [Sat Sep 24 19:33:39 2022] POST /identity/v3/projects => generated 379 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 24 19:33:39.763815 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0f6bfe-92a1-46b7-b2c4-4441ac0add11 admin admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:33:39.782091 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 585/1164] 10.222.0.18 () {60 vars in 1153 bytes} [Sat Sep 24 19:33:39 2022] POST /identity/v3/projects => generated 383 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 24 19:33:39.787244 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da6a024-45d9-4bb2-ba31-2ff3ecae9164 admin admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:33:39.841758 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0f6bfe-92a1-46b7-b2c4-4441ac0add11 admin admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:33:39.846650 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af64955b-fe57-4d9b-9789-32fd6c616fac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fc67bd325c24a418945f738b4bd5c71', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:33:39.847248 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af64955b-fe57-4d9b-9789-32fd6c616fac admin admin] REQUEST_METHOD: `POST` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:33:39.848046 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af64955b-fe57-4d9b-9789-32fd6c616fac admin admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:33:39.848309 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af64955b-fe57-4d9b-9789-32fd6c616fac admin admin] PATH_INFO: `/v3/users` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:33:39.848928 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af64955b-fe57-4d9b-9789-32fd6c616fac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:33:39.850221 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da6a024-45d9-4bb2-ba31-2ff3ecae9164 admin admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:33:39.851231 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af64955b-fe57-4d9b-9789-32fd6c616fac admin admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:33:39.855098 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3a55bf-8bb5-4496-a78c-f01291a517a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fc67bd325c24a418945f738b4bd5c71', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:33:39.855640 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3a55bf-8bb5-4496-a78c-f01291a517a0 admin admin] REQUEST_METHOD: `POST` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:33:39.855915 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3a55bf-8bb5-4496-a78c-f01291a517a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:33:39.856184 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3a55bf-8bb5-4496-a78c-f01291a517a0 admin admin] PATH_INFO: `/v3/users` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:33:39.856835 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3a55bf-8bb5-4496-a78c-f01291a517a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:33:39.857862 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: WARNING py.warnings [None req-fc3a55bf-8bb5-4496-a78c-f01291a517a0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 24 19:33:39.857862 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: warnings.warn(msg) Sep 24 19:33:39.857862 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: Sep 24 19:33:39.859175 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3a55bf-8bb5-4496-a78c-f01291a517a0 admin admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:33:39.877740 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 580/1165] 10.222.0.18 () {60 vars in 1144 bytes} [Sat Sep 24 19:33:39 2022] POST /identity/v3/users => generated 290 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:33:39.881019 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 586/1166] 10.222.0.18 () {60 vars in 1144 bytes} [Sat Sep 24 19:33:39 2022] POST /identity/v3/users => generated 292 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:33:39.884667 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af64955b-fe57-4d9b-9789-32fd6c616fac admin admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:33:39.884862 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3a55bf-8bb5-4496-a78c-f01291a517a0 admin admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:33:39.894297 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af64955b-fe57-4d9b-9789-32fd6c616fac admin admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:33:39.894808 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3a55bf-8bb5-4496-a78c-f01291a517a0 admin admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:33:39.898818 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7f7de4-b7a3-443a-ba16-15caf991a62b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fc67bd325c24a418945f738b4bd5c71', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:33:39.899402 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7f7de4-b7a3-443a-ba16-15caf991a62b admin admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:33:39.899679 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7f7de4-b7a3-443a-ba16-15caf991a62b admin admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:33:39.899804 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac18746a-ff88-40ba-92fa-c93d51f6f848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fc67bd325c24a418945f738b4bd5c71', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:33:39.899947 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7f7de4-b7a3-443a-ba16-15caf991a62b admin admin] PATH_INFO: `/v3/roles` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:33:39.900375 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac18746a-ff88-40ba-92fa-c93d51f6f848 admin admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:33:39.900573 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7f7de4-b7a3-443a-ba16-15caf991a62b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:33:39.900666 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac18746a-ff88-40ba-92fa-c93d51f6f848 admin admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:33:39.900916 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac18746a-ff88-40ba-92fa-c93d51f6f848 admin admin] PATH_INFO: `/v3/roles` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:33:39.901548 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac18746a-ff88-40ba-92fa-c93d51f6f848 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:33:39.902209 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7f7de4-b7a3-443a-ba16-15caf991a62b admin admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:33:39.903169 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac18746a-ff88-40ba-92fa-c93d51f6f848 admin admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:33:39.912940 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 581/1167] 10.222.0.18 () {58 vars in 1122 bytes} [Sat Sep 24 19:33:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 24 19:33:39.916344 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 587/1168] 10.222.0.18 () {58 vars in 1122 bytes} [Sat Sep 24 19:33:39 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 24 19:33:39.916779 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7f7de4-b7a3-443a-ba16-15caf991a62b admin admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:33:39.917372 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac18746a-ff88-40ba-92fa-c93d51f6f848 admin admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:33:39.930835 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7f7de4-b7a3-443a-ba16-15caf991a62b admin admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:33:39.931068 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac18746a-ff88-40ba-92fa-c93d51f6f848 admin admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:33:39.935656 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097da32b-091c-4867-b9de-602dade55bb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fc67bd325c24a418945f738b4bd5c71', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:33:39.935856 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8929f28-054a-45d1-b263-9c567fbec29d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fc67bd325c24a418945f738b4bd5c71', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:33:39.936253 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097da32b-091c-4867-b9de-602dade55bb2 admin admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:33:39.936523 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097da32b-091c-4867-b9de-602dade55bb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:33:39.936635 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8929f28-054a-45d1-b263-9c567fbec29d admin admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:33:39.936786 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097da32b-091c-4867-b9de-602dade55bb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:33:39.936882 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8929f28-054a-45d1-b263-9c567fbec29d admin admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:33:39.937111 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8929f28-054a-45d1-b263-9c567fbec29d admin admin] PATH_INFO: `/v3/roles` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:33:39.937418 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097da32b-091c-4867-b9de-602dade55bb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:33:39.937739 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8929f28-054a-45d1-b263-9c567fbec29d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:33:39.939032 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097da32b-091c-4867-b9de-602dade55bb2 admin admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:33:39.939329 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8929f28-054a-45d1-b263-9c567fbec29d admin admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:33:39.950298 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 582/1169] 10.222.0.18 () {58 vars in 1122 bytes} [Sat Sep 24 19:33:39 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 24 19:33:39.950937 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 588/1170] 10.222.0.18 () {58 vars in 1122 bytes} [Sat Sep 24 19:33:39 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 19:33:39.954477 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8929f28-054a-45d1-b263-9c567fbec29d admin admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:33:39.954812 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097da32b-091c-4867-b9de-602dade55bb2 admin admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:33:39.964219 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8929f28-054a-45d1-b263-9c567fbec29d admin admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:33:39.964390 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097da32b-091c-4867-b9de-602dade55bb2 admin admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:33:39.968773 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9f2bef-844f-44da-88c8-e1e7def7c4a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fc67bd325c24a418945f738b4bd5c71', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:33:39.968918 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea3dc62-c40c-485d-a4af-4598f9e98ad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fc67bd325c24a418945f738b4bd5c71', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:33:39.969413 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9f2bef-844f-44da-88c8-e1e7def7c4a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:33:39.969532 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea3dc62-c40c-485d-a4af-4598f9e98ad9 admin admin] REQUEST_METHOD: `PUT` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:33:39.969689 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9f2bef-844f-44da-88c8-e1e7def7c4a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:33:39.969813 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea3dc62-c40c-485d-a4af-4598f9e98ad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:33:39.969989 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea3dc62-c40c-485d-a4af-4598f9e98ad9 admin admin] PATH_INFO: `/v3/projects/c9f9ab6ea7f64dc396a4daccfe52136b/users/0c9fa234c1ce4191b1291c92e25557ed/roles/3a42524fc57c4487a34c5c05234413a7` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:33:39.970106 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9f2bef-844f-44da-88c8-e1e7def7c4a4 admin admin] PATH_INFO: `/v3/projects/01809e3784b941869911443a3d0cd044/users/2aa8e7afc84049d7a339e6e584eeb71a/roles/3a42524fc57c4487a34c5c05234413a7` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:33:39.985480 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9f2bef-844f-44da-88c8-e1e7def7c4a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01809e3784b941869911443a3d0cd044, user_id=2aa8e7afc84049d7a339e6e584eeb71a, role_id=3a42524fc57c4487a34c5c05234413a7)` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:33:39.986548 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: WARNING py.warnings [None req-8c9f2bef-844f-44da-88c8-e1e7def7c4a4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 24 19:33:39.986548 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: warnings.warn(msg) Sep 24 19:33:39.986548 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: Sep 24 19:33:39.986952 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea3dc62-c40c-485d-a4af-4598f9e98ad9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9f9ab6ea7f64dc396a4daccfe52136b, user_id=0c9fa234c1ce4191b1291c92e25557ed, role_id=3a42524fc57c4487a34c5c05234413a7)` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:33:39.989024 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9f2bef-844f-44da-88c8-e1e7def7c4a4 admin admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:33:39.990511 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea3dc62-c40c-485d-a4af-4598f9e98ad9 admin admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:33:40.002611 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 583/1171] 10.222.0.18 () {60 vars in 1483 bytes} [Sat Sep 24 19:33:39 2022] PUT /identity/v3/projects/01809e3784b941869911443a3d0cd044/users/2aa8e7afc84049d7a339e6e584eeb71a/roles/3a42524fc57c4487a34c5c05234413a7 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:33:40.003869 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 589/1172] 10.222.0.18 () {60 vars in 1483 bytes} [Sat Sep 24 19:33:39 2022] PUT /identity/v3/projects/c9f9ab6ea7f64dc396a4daccfe52136b/users/0c9fa234c1ce4191b1291c92e25557ed/roles/3a42524fc57c4487a34c5c05234413a7 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 24 19:33:40.007592 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4b0fc6-21c7-4ef3-9da8-ec13f4672388 None None] REQUEST_METHOD: `POST` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:33:40.008026 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4b0fc6-21c7-4ef3-9da8-ec13f4672388 None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:33:40.008306 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4b0fc6-21c7-4ef3-9da8-ec13f4672388 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:33:40.008671 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a650a6-acc4-41cc-b530-dbb82710ee91 None None] REQUEST_METHOD: `POST` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:33:40.008965 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a650a6-acc4-41cc-b530-dbb82710ee91 None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:33:40.009238 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a650a6-acc4-41cc-b530-dbb82710ee91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:33:40.027342 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.auth.core [None req-fa4b0fc6-21c7-4ef3-9da8-ec13f4672388 None None] MFA Rules not processed for user `3dbbb9909cec43ff99c1c3682f016ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=88081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:33:40.027552 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.auth.core [None req-21a650a6-acc4-41cc-b530-dbb82710ee91 None None] MFA Rules not processed for user `3dbbb9909cec43ff99c1c3682f016ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=88080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:33:40.028513 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.fernet_utils [None req-fa4b0fc6-21c7-4ef3-9da8-ec13f4672388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:33:40.028628 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.fernet_utils [None req-21a650a6-acc4-41cc-b530-dbb82710ee91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:33:40.076711 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:33:40.077458 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:33:40.090349 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 590/1173] 10.222.0.18 () {58 vars in 958 bytes} [Sat Sep 24 19:33:40 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:33:40.090776 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 584/1174] 10.222.0.18 () {58 vars in 958 bytes} [Sat Sep 24 19:33:40 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:33:40.101020 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4b0fc6-21c7-4ef3-9da8-ec13f4672388 None None] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:33:40.101174 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a650a6-acc4-41cc-b530-dbb82710ee91 None None] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:33:40.102436 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.fernet_utils [None req-21a650a6-acc4-41cc-b530-dbb82710ee91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:33:40.157906 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4b0fc6-21c7-4ef3-9da8-ec13f4672388 None None] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:33:40.159232 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a650a6-acc4-41cc-b530-dbb82710ee91 None None] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:33:40.162129 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad72b27-5d12-4389-937a-d75a4ce469fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ef291c173794b49ade9469a5ef72e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dfa5c2c17244006bdd629ec81553f1a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:33:40.162735 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad72b27-5d12-4389-937a-d75a4ce469fe service neutron] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:33:40.163010 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad72b27-5d12-4389-937a-d75a4ce469fe service neutron] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:33:40.163280 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad72b27-5d12-4389-937a-d75a4ce469fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:33:40.163654 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c375c65d-4565-4cc8-b52b-fdfd19cb4265 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ef291c173794b49ade9469a5ef72e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dfa5c2c17244006bdd629ec81553f1a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:33:40.164248 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c375c65d-4565-4cc8-b52b-fdfd19cb4265 service neutron] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:33:40.164522 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c375c65d-4565-4cc8-b52b-fdfd19cb4265 service neutron] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:33:40.164786 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c375c65d-4565-4cc8-b52b-fdfd19cb4265 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:33:40.172325 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad72b27-5d12-4389-937a-d75a4ce469fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:33:40.173738 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c375c65d-4565-4cc8-b52b-fdfd19cb4265 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:33:40.173945 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad72b27-5d12-4389-937a-d75a4ce469fe service neutron] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:33:40.175178 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c375c65d-4565-4cc8-b52b-fdfd19cb4265 service neutron] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:33:40.183610 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 585/1175] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Sep 24 19:33:40 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:33:40.185184 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 591/1176] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Sep 24 19:33:40 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:33:44.600704 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cefa40-4f19-4f5d-aa8a-bbff53548cd0 None None] REQUEST_METHOD: `POST` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:33:44.601289 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cefa40-4f19-4f5d-aa8a-bbff53548cd0 None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:33:44.601289 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cefa40-4f19-4f5d-aa8a-bbff53548cd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:33:44.651670 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.auth.core [None req-d8cefa40-4f19-4f5d-aa8a-bbff53548cd0 None None] MFA Rules not processed for user `2aa8e7afc84049d7a339e6e584eeb71a`. Rule list: `[]` (Enabled: `True`). {{(pid=88081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:33:44.652659 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.fernet_utils [None req-d8cefa40-4f19-4f5d-aa8a-bbff53548cd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:33:44.813604 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 586/1177] 10.222.0.18 () {58 vars in 958 bytes} [Sat Sep 24 19:33:44 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:33:44.818075 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c375c65d-4565-4cc8-b52b-fdfd19cb4265 service neutron] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:33:44.853094 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c375c65d-4565-4cc8-b52b-fdfd19cb4265 service neutron] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:33:44.859134 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8250e939-a9e3-4497-ada9-56bfebd01cd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fc67bd325c24a418945f738b4bd5c71', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:33:44.860115 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8250e939-a9e3-4497-ada9-56bfebd01cd5 admin admin] REQUEST_METHOD: `POST` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:33:44.860632 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8250e939-a9e3-4497-ada9-56bfebd01cd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:33:44.861119 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8250e939-a9e3-4497-ada9-56bfebd01cd5 admin admin] PATH_INFO: `/v3/projects` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:33:44.862063 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8250e939-a9e3-4497-ada9-56bfebd01cd5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:33:44.864815 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8250e939-a9e3-4497-ada9-56bfebd01cd5 admin admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:33:44.921760 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 592/1178] 10.222.0.18 () {60 vars in 1153 bytes} [Sat Sep 24 19:33:44 2022] POST /identity/v3/projects => generated 379 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 24 19:33:44.929350 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cefa40-4f19-4f5d-aa8a-bbff53548cd0 None None] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:33:44.947766 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cefa40-4f19-4f5d-aa8a-bbff53548cd0 None None] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:33:45.102771 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584da247-8594-4f8b-85de-47c85e9f4611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fc67bd325c24a418945f738b4bd5c71', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:33:45.103797 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584da247-8594-4f8b-85de-47c85e9f4611 admin admin] REQUEST_METHOD: `POST` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:33:45.104332 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584da247-8594-4f8b-85de-47c85e9f4611 admin admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:33:45.104800 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584da247-8594-4f8b-85de-47c85e9f4611 admin admin] PATH_INFO: `/v3/users` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:33:45.105630 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584da247-8594-4f8b-85de-47c85e9f4611 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:33:45.109316 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584da247-8594-4f8b-85de-47c85e9f4611 admin admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:33:45.164353 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 587/1179] 10.222.0.18 () {60 vars in 1144 bytes} [Sat Sep 24 19:33:44 2022] POST /identity/v3/users => generated 296 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:33:45.167517 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8250e939-a9e3-4497-ada9-56bfebd01cd5 admin admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:33:45.208582 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8250e939-a9e3-4497-ada9-56bfebd01cd5 admin admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:33:45.222168 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b5a865-9d3c-43e2-adcb-75326c2a305f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fc67bd325c24a418945f738b4bd5c71', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:33:45.222916 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b5a865-9d3c-43e2-adcb-75326c2a305f admin admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:33:45.223268 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b5a865-9d3c-43e2-adcb-75326c2a305f admin admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:33:45.224351 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b5a865-9d3c-43e2-adcb-75326c2a305f admin admin] PATH_INFO: `/v3/roles` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:33:45.225770 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b5a865-9d3c-43e2-adcb-75326c2a305f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:33:45.229162 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b5a865-9d3c-43e2-adcb-75326c2a305f admin admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:33:45.254442 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 593/1180] 10.222.0.18 () {58 vars in 1122 bytes} [Sat Sep 24 19:33:45 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 24 19:33:45.258621 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584da247-8594-4f8b-85de-47c85e9f4611 admin admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:33:45.272004 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584da247-8594-4f8b-85de-47c85e9f4611 admin admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:33:45.290889 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef95b69-2250-4563-b7cd-1a9b5989c768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fc67bd325c24a418945f738b4bd5c71', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:33:45.291606 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef95b69-2250-4563-b7cd-1a9b5989c768 admin admin] REQUEST_METHOD: `PUT` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:33:45.291889 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef95b69-2250-4563-b7cd-1a9b5989c768 admin admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:33:45.292171 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef95b69-2250-4563-b7cd-1a9b5989c768 admin admin] PATH_INFO: `/v3/projects/5c17b8437cff4a33a10d65729e14305f/users/866a9e7e36134d7289795fced1f88306/roles/4c7d0dafc19b4b0a9821be6ec0da0a8f` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:33:45.322696 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef95b69-2250-4563-b7cd-1a9b5989c768 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c17b8437cff4a33a10d65729e14305f, user_id=866a9e7e36134d7289795fced1f88306, role_id=4c7d0dafc19b4b0a9821be6ec0da0a8f)` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:33:45.325422 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef95b69-2250-4563-b7cd-1a9b5989c768 admin admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:33:45.328224 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:33:45.356134 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 588/1181] 10.222.0.18 () {60 vars in 1483 bytes} [Sat Sep 24 19:33:45 2022] PUT /identity/v3/projects/5c17b8437cff4a33a10d65729e14305f/users/866a9e7e36134d7289795fced1f88306/roles/4c7d0dafc19b4b0a9821be6ec0da0a8f => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:33:45.362328 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b5a865-9d3c-43e2-adcb-75326c2a305f admin admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:33:45.381409 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b5a865-9d3c-43e2-adcb-75326c2a305f admin admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:33:45.569946 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bad1544-bcb9-43c7-bcc3-d291b57e6aae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fc67bd325c24a418945f738b4bd5c71', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:33:45.572488 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bad1544-bcb9-43c7-bcc3-d291b57e6aae admin admin] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:33:45.573235 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bad1544-bcb9-43c7-bcc3-d291b57e6aae admin admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:33:45.573655 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bad1544-bcb9-43c7-bcc3-d291b57e6aae admin admin] PATH_INFO: `/v3/roles` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:33:45.574596 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bad1544-bcb9-43c7-bcc3-d291b57e6aae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:33:45.576828 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bad1544-bcb9-43c7-bcc3-d291b57e6aae admin admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:33:45.605237 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef95b69-2250-4563-b7cd-1a9b5989c768 admin admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:33:45.617879 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 594/1182] 10.222.0.18 () {58 vars in 1122 bytes} [Sat Sep 24 19:33:45 2022] GET /identity/v3/roles => generated 1420 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 24 19:33:45.620127 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef95b69-2250-4563-b7cd-1a9b5989c768 admin admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:33:45.632625 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcbdd76-6457-44fa-a844-62906877a374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fc67bd325c24a418945f738b4bd5c71', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:33:45.633323 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcbdd76-6457-44fa-a844-62906877a374 admin admin] REQUEST_METHOD: `PUT` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:33:45.633601 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcbdd76-6457-44fa-a844-62906877a374 admin admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:33:45.635055 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcbdd76-6457-44fa-a844-62906877a374 admin admin] PATH_INFO: `/v3/projects/5c17b8437cff4a33a10d65729e14305f/users/866a9e7e36134d7289795fced1f88306/roles/4c7d0dafc19b4b0a9821be6ec0da0a8f` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:33:45.638929 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcbdd76-6457-44fa-a844-62906877a374 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c17b8437cff4a33a10d65729e14305f, user_id=866a9e7e36134d7289795fced1f88306, role_id=4c7d0dafc19b4b0a9821be6ec0da0a8f)` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:33:45.648391 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcbdd76-6457-44fa-a844-62906877a374 admin admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:33:45.674448 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 589/1183] 10.222.0.18 () {60 vars in 1483 bytes} [Sat Sep 24 19:33:45 2022] PUT /identity/v3/projects/5c17b8437cff4a33a10d65729e14305f/users/866a9e7e36134d7289795fced1f88306/roles/4c7d0dafc19b4b0a9821be6ec0da0a8f => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 24 19:33:45.999818 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a32f574-63c9-46e8-853a-ee0d2f40bd07 None None] REQUEST_METHOD: `POST` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:33:46.001604 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a32f574-63c9-46e8-853a-ee0d2f40bd07 None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:33:46.002218 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a32f574-63c9-46e8-853a-ee0d2f40bd07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:33:46.066533 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.auth.core [None req-4a32f574-63c9-46e8-853a-ee0d2f40bd07 None None] MFA Rules not processed for user `0c9fa234c1ce4191b1291c92e25557ed`. Rule list: `[]` (Enabled: `True`). {{(pid=88080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:33:46.067792 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.fernet_utils [None req-4a32f574-63c9-46e8-853a-ee0d2f40bd07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:33:46.164931 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:33:46.200240 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 595/1184] 10.222.0.18 () {58 vars in 958 bytes} [Sat Sep 24 19:33:45 2022] POST /identity/v3/auth/tokens => generated 2820 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 19:33:46.205816 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcbdd76-6457-44fa-a844-62906877a374 admin admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:33:46.409373 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcbdd76-6457-44fa-a844-62906877a374 admin admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:33:46.418591 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179e661d-d97b-48e5-b5b0-1423d97468a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fc67bd325c24a418945f738b4bd5c71', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:33:46.419330 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179e661d-d97b-48e5-b5b0-1423d97468a0 admin admin] REQUEST_METHOD: `POST` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:33:46.419805 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179e661d-d97b-48e5-b5b0-1423d97468a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:33:46.420135 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179e661d-d97b-48e5-b5b0-1423d97468a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:33:46.420860 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179e661d-d97b-48e5-b5b0-1423d97468a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:33:46.424942 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179e661d-d97b-48e5-b5b0-1423d97468a0 admin admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:33:46.478756 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a32f574-63c9-46e8-853a-ee0d2f40bd07 None None] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:33:46.484805 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 590/1185] 10.222.0.18 () {60 vars in 1153 bytes} [Sat Sep 24 19:33:46 2022] POST /identity/v3/projects => generated 383 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:33:46.490915 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a32f574-63c9-46e8-853a-ee0d2f40bd07 None None] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:33:46.562616 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b36c2af-cd15-4d18-ad74-f32df918535d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fc67bd325c24a418945f738b4bd5c71', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:33:46.563361 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b36c2af-cd15-4d18-ad74-f32df918535d admin admin] REQUEST_METHOD: `POST` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:33:46.563704 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b36c2af-cd15-4d18-ad74-f32df918535d admin admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:33:46.564039 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b36c2af-cd15-4d18-ad74-f32df918535d admin admin] PATH_INFO: `/v3/users` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:33:46.565011 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b36c2af-cd15-4d18-ad74-f32df918535d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:33:46.567591 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b36c2af-cd15-4d18-ad74-f32df918535d admin admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:33:46.609800 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179e661d-d97b-48e5-b5b0-1423d97468a0 admin admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:33:46.618656 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 596/1186] 10.222.0.18 () {60 vars in 1144 bytes} [Sat Sep 24 19:33:46 2022] POST /identity/v3/users => generated 298 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 19:33:46.628992 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179e661d-d97b-48e5-b5b0-1423d97468a0 admin admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:33:46.637766 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd92c79-dac7-4e5f-b323-3a1f58c65567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fc67bd325c24a418945f738b4bd5c71', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:33:46.638469 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd92c79-dac7-4e5f-b323-3a1f58c65567 admin admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:33:46.638746 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd92c79-dac7-4e5f-b323-3a1f58c65567 admin admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:33:46.639204 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd92c79-dac7-4e5f-b323-3a1f58c65567 admin admin] PATH_INFO: `/v3/roles` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:33:46.640523 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd92c79-dac7-4e5f-b323-3a1f58c65567 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:33:46.641969 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd92c79-dac7-4e5f-b323-3a1f58c65567 admin admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:33:46.663221 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b36c2af-cd15-4d18-ad74-f32df918535d admin admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:33:46.674160 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 591/1187] 10.222.0.18 () {58 vars in 1122 bytes} [Sat Sep 24 19:33:46 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 24 19:33:46.676956 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b36c2af-cd15-4d18-ad74-f32df918535d admin admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:33:46.682636 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c0a137-b1c3-49a1-8fc9-131c6e0fd6f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fc67bd325c24a418945f738b4bd5c71', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:33:46.683849 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c0a137-b1c3-49a1-8fc9-131c6e0fd6f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:33:46.684124 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c0a137-b1c3-49a1-8fc9-131c6e0fd6f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:33:46.684395 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c0a137-b1c3-49a1-8fc9-131c6e0fd6f3 admin admin] PATH_INFO: `/v3/projects/3f730135f9f54231b3f5c6eac8b324ee/users/44ba37d04b1a4e6985858d750c51769f/roles/4c7d0dafc19b4b0a9821be6ec0da0a8f` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:33:46.730773 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c0a137-b1c3-49a1-8fc9-131c6e0fd6f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f730135f9f54231b3f5c6eac8b324ee, user_id=44ba37d04b1a4e6985858d750c51769f, role_id=4c7d0dafc19b4b0a9821be6ec0da0a8f)` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:33:46.733913 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c0a137-b1c3-49a1-8fc9-131c6e0fd6f3 admin admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:33:46.767319 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 597/1188] 10.222.0.18 () {60 vars in 1483 bytes} [Sat Sep 24 19:33:46 2022] PUT /identity/v3/projects/3f730135f9f54231b3f5c6eac8b324ee/users/44ba37d04b1a4e6985858d750c51769f/roles/4c7d0dafc19b4b0a9821be6ec0da0a8f => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:33:46.768555 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd92c79-dac7-4e5f-b323-3a1f58c65567 admin admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:33:46.792149 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd92c79-dac7-4e5f-b323-3a1f58c65567 admin admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:33:46.979809 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bf7d21-2011-4c54-80a1-95f353d635c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fc67bd325c24a418945f738b4bd5c71', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:33:46.980446 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bf7d21-2011-4c54-80a1-95f353d635c5 admin admin] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:33:46.980722 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bf7d21-2011-4c54-80a1-95f353d635c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:33:46.981226 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bf7d21-2011-4c54-80a1-95f353d635c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:33:46.981929 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bf7d21-2011-4c54-80a1-95f353d635c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:33:46.984295 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bf7d21-2011-4c54-80a1-95f353d635c5 admin admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:33:47.000792 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 592/1189] 10.222.0.18 () {58 vars in 1122 bytes} [Sat Sep 24 19:33:46 2022] GET /identity/v3/roles => generated 1420 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 19:33:47.002329 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c0a137-b1c3-49a1-8fc9-131c6e0fd6f3 admin admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:33:47.020782 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c0a137-b1c3-49a1-8fc9-131c6e0fd6f3 admin admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:33:47.061076 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81e150f-c9c1-4900-b9c8-d745c6cc4e36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fc67bd325c24a418945f738b4bd5c71', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:33:47.062229 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81e150f-c9c1-4900-b9c8-d745c6cc4e36 admin admin] REQUEST_METHOD: `PUT` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:33:47.062651 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81e150f-c9c1-4900-b9c8-d745c6cc4e36 admin admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:33:47.063214 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81e150f-c9c1-4900-b9c8-d745c6cc4e36 admin admin] PATH_INFO: `/v3/projects/3f730135f9f54231b3f5c6eac8b324ee/users/44ba37d04b1a4e6985858d750c51769f/roles/4c7d0dafc19b4b0a9821be6ec0da0a8f` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:33:47.065479 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81e150f-c9c1-4900-b9c8-d745c6cc4e36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f730135f9f54231b3f5c6eac8b324ee, user_id=44ba37d04b1a4e6985858d750c51769f, role_id=4c7d0dafc19b4b0a9821be6ec0da0a8f)` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:33:47.068792 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81e150f-c9c1-4900-b9c8-d745c6cc4e36 admin admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:33:47.093254 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 598/1190] 10.222.0.18 () {60 vars in 1483 bytes} [Sat Sep 24 19:33:47 2022] PUT /identity/v3/projects/3f730135f9f54231b3f5c6eac8b324ee/users/44ba37d04b1a4e6985858d750c51769f/roles/4c7d0dafc19b4b0a9821be6ec0da0a8f => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:33:53.213790 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49813fa2-dc76-4d75-825b-29ede055e6e2 None None] REQUEST_METHOD: `POST` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:33:53.214307 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49813fa2-dc76-4d75-825b-29ede055e6e2 None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:33:53.214424 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49813fa2-dc76-4d75-825b-29ede055e6e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:33:53.277082 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.auth.core [None req-49813fa2-dc76-4d75-825b-29ede055e6e2 None None] MFA Rules not processed for user `866a9e7e36134d7289795fced1f88306`. Rule list: `[]` (Enabled: `True`). {{(pid=88081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:33:53.291476 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.fernet_utils [None req-49813fa2-dc76-4d75-825b-29ede055e6e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:33:53.373119 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:33:53.428903 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 593/1191] 10.222.0.18 () {58 vars in 958 bytes} [Sat Sep 24 19:33:53 2022] POST /identity/v3/auth/tokens => generated 2883 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:33:53.443064 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81e150f-c9c1-4900-b9c8-d745c6cc4e36 admin admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:33:53.445806 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.fernet_utils [None req-d81e150f-c9c1-4900-b9c8-d745c6cc4e36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:33:53.579416 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81e150f-c9c1-4900-b9c8-d745c6cc4e36 admin admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:33:53.587614 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7ced32-4d09-44fe-a65a-a1492de3799b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '135ee6a2c657412ba6d65a51403ef4d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dfa5c2c17244006bdd629ec81553f1a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:33:53.589025 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7ced32-4d09-44fe-a65a-a1492de3799b service glance] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:33:53.590185 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7ced32-4d09-44fe-a65a-a1492de3799b service glance] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:33:53.590892 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7ced32-4d09-44fe-a65a-a1492de3799b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:33:53.685875 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:33:53.710348 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7ced32-4d09-44fe-a65a-a1492de3799b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:33:53.712968 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7ced32-4d09-44fe-a65a-a1492de3799b service glance] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:33:53.729880 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 599/1192] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Sep 24 19:33:53 2022] GET /identity/v3/auth/tokens => generated 2816 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:33:54.119293 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c1afd9-24a5-42ee-bfa5-1f4b5babcf5b None None] REQUEST_METHOD: `POST` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:33:54.119584 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c1afd9-24a5-42ee-bfa5-1f4b5babcf5b None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:33:54.119857 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c1afd9-24a5-42ee-bfa5-1f4b5babcf5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:33:54.166849 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.auth.core [None req-78c1afd9-24a5-42ee-bfa5-1f4b5babcf5b None None] MFA Rules not processed for user `44ba37d04b1a4e6985858d750c51769f`. Rule list: `[]` (Enabled: `True`). {{(pid=88081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:33:54.169436 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.fernet_utils [None req-78c1afd9-24a5-42ee-bfa5-1f4b5babcf5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:33:54.256835 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 594/1193] 10.222.0.18 () {58 vars in 958 bytes} [Sat Sep 24 19:33:54 2022] POST /identity/v3/auth/tokens => generated 2887 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:33:54.271912 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7ced32-4d09-44fe-a65a-a1492de3799b service glance] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:33:54.284474 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7ced32-4d09-44fe-a65a-a1492de3799b service glance] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:33:54.289426 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f4702b-8068-4190-b33a-7ebb6f315e06 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '135ee6a2c657412ba6d65a51403ef4d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dfa5c2c17244006bdd629ec81553f1a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:33:54.291024 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f4702b-8068-4190-b33a-7ebb6f315e06 service glance] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:33:54.291598 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f4702b-8068-4190-b33a-7ebb6f315e06 service glance] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:33:54.292050 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f4702b-8068-4190-b33a-7ebb6f315e06 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:33:54.377017 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f4702b-8068-4190-b33a-7ebb6f315e06 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:33:54.378599 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f4702b-8068-4190-b33a-7ebb6f315e06 service glance] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:33:54.391803 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 600/1194] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Sep 24 19:33:54 2022] GET /identity/v3/auth/tokens => generated 2820 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:34:02.894208 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d782d3a7-610a-4508-87ca-438e5d256b81 None None] REQUEST_METHOD: `POST` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:34:02.894783 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d782d3a7-610a-4508-87ca-438e5d256b81 None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:34:02.894783 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d782d3a7-610a-4508-87ca-438e5d256b81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:34:02.930015 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.auth.core [None req-d782d3a7-610a-4508-87ca-438e5d256b81 None None] MFA Rules not processed for user `0c9fa234c1ce4191b1291c92e25557ed`. Rule list: `[]` (Enabled: `True`). {{(pid=88081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:34:02.931246 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.fernet_utils [None req-d782d3a7-610a-4508-87ca-438e5d256b81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:34:02.953572 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 595/1195] 10.222.0.18 () {58 vars in 958 bytes} [Sat Sep 24 19:34:02 2022] POST /identity/v3/auth/tokens => generated 2820 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:34:03.293390 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af19e4c-6cc7-4f1b-b297-aafde285c1c3 None None] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:34:03.294020 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af19e4c-6cc7-4f1b-b297-aafde285c1c3 None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:34:03.294120 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af19e4c-6cc7-4f1b-b297-aafde285c1c3 None None] PATH_INFO: `/` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:34:03.296868 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 601/1196] 10.222.0.18 () {54 vars in 961 bytes} [Sat Sep 24 19:34:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:34:03.307933 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80963992-f085-44d9-bb54-8a095b480023 None None] REQUEST_METHOD: `POST` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:34:03.312873 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80963992-f085-44d9-bb54-8a095b480023 None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:34:03.312873 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80963992-f085-44d9-bb54-8a095b480023 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:34:03.352507 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.auth.core [None req-80963992-f085-44d9-bb54-8a095b480023 None None] MFA Rules not processed for user `0ab73abe1c6e4b25a17281f4cd8e97e9`. Rule list: `[]` (Enabled: `True`). {{(pid=88081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:34:03.353765 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.fernet_utils [None req-80963992-f085-44d9-bb54-8a095b480023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:34:03.462689 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 596/1197] 10.222.0.18 () {58 vars in 1058 bytes} [Sat Sep 24 19:34:03 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:34:03.468417 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8d223b-e65a-41a8-87fe-96fbf8cf0afe None None] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:34:03.470908 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8d223b-e65a-41a8-87fe-96fbf8cf0afe None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:34:03.471436 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8d223b-e65a-41a8-87fe-96fbf8cf0afe None None] PATH_INFO: `/` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:34:03.477664 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 602/1198] 10.222.0.18 () {54 vars in 912 bytes} [Sat Sep 24 19:34:03 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:34:03.483639 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5616f931-007c-4dff-9932-4b64d33de11b None None] REQUEST_METHOD: `POST` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:34:03.484018 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5616f931-007c-4dff-9932-4b64d33de11b None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:34:03.484362 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5616f931-007c-4dff-9932-4b64d33de11b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:34:03.511169 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.auth.core [None req-5616f931-007c-4dff-9932-4b64d33de11b None None] MFA Rules not processed for user `0ab73abe1c6e4b25a17281f4cd8e97e9`. Rule list: `[]` (Enabled: `True`). {{(pid=88081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:34:03.512706 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.fernet_utils [None req-5616f931-007c-4dff-9932-4b64d33de11b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:34:03.524184 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 597/1199] 10.222.0.18 () {58 vars in 1009 bytes} [Sat Sep 24 19:34:03 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:34:03.537115 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8d223b-e65a-41a8-87fe-96fbf8cf0afe None None] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:34:03.539062 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.fernet_utils [None req-dc8d223b-e65a-41a8-87fe-96fbf8cf0afe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:34:03.554564 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8d223b-e65a-41a8-87fe-96fbf8cf0afe None None] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:34:03.563722 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65293a1-14d6-4b27-9581-239a146bcb49 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '135ee6a2c657412ba6d65a51403ef4d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dfa5c2c17244006bdd629ec81553f1a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:34:03.564544 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65293a1-14d6-4b27-9581-239a146bcb49 service glance] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:34:03.565503 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65293a1-14d6-4b27-9581-239a146bcb49 service glance] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:34:03.565864 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65293a1-14d6-4b27-9581-239a146bcb49 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:34:03.583211 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65293a1-14d6-4b27-9581-239a146bcb49 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:34:03.584977 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65293a1-14d6-4b27-9581-239a146bcb49 service glance] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:34:03.600558 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 603/1200] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Sep 24 19:34:03 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:34:04.152520 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b65a683-3dd4-45e3-896f-d66d9118362a None None] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:34:04.153040 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b65a683-3dd4-45e3-896f-d66d9118362a None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:34:04.153316 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b65a683-3dd4-45e3-896f-d66d9118362a None None] PATH_INFO: `/` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:34:04.154820 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 598/1201] 10.222.0.18 () {54 vars in 912 bytes} [Sat Sep 24 19:34:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:34:04.160535 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8ee0ed-b03a-4c65-a6d8-d60b8106ebc4 None None] REQUEST_METHOD: `POST` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:34:04.160733 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8ee0ed-b03a-4c65-a6d8-d60b8106ebc4 None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:34:04.161008 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8ee0ed-b03a-4c65-a6d8-d60b8106ebc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:34:04.181996 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.auth.core [None req-3e8ee0ed-b03a-4c65-a6d8-d60b8106ebc4 None None] MFA Rules not processed for user `2ef291c173794b49ade9469a5ef72e08`. Rule list: `[]` (Enabled: `True`). {{(pid=88080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:34:04.183180 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.fernet_utils [None req-3e8ee0ed-b03a-4c65-a6d8-d60b8106ebc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:34:04.257376 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 604/1202] 10.222.0.18 () {58 vars in 1009 bytes} [Sat Sep 24 19:34:04 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:34:04.268878 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b65a683-3dd4-45e3-896f-d66d9118362a None None] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:34:04.279628 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b65a683-3dd4-45e3-896f-d66d9118362a None None] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:34:04.283373 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28af505-7bd1-40fa-97db-20e96ef83cf4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ef291c173794b49ade9469a5ef72e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dfa5c2c17244006bdd629ec81553f1a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:34:04.283985 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28af505-7bd1-40fa-97db-20e96ef83cf4 service neutron] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:34:04.284257 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28af505-7bd1-40fa-97db-20e96ef83cf4 service neutron] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:34:04.284525 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28af505-7bd1-40fa-97db-20e96ef83cf4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:34:04.292125 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28af505-7bd1-40fa-97db-20e96ef83cf4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:34:04.293547 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28af505-7bd1-40fa-97db-20e96ef83cf4 service neutron] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:34:04.303178 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 599/1203] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Sep 24 19:34:04 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:34:04.738750 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a347f0-f8cb-4a48-99aa-113d05ce5b93 None None] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:34:04.739303 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a347f0-f8cb-4a48-99aa-113d05ce5b93 None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:34:04.739303 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a347f0-f8cb-4a48-99aa-113d05ce5b93 None None] PATH_INFO: `/` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:34:04.741313 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 605/1204] 10.222.0.18 () {54 vars in 961 bytes} [Sat Sep 24 19:34:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:34:04.753255 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aa41f3-18e0-4d80-bf1f-a2a619f2827c None None] REQUEST_METHOD: `POST` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:34:04.753255 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aa41f3-18e0-4d80-bf1f-a2a619f2827c None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:34:04.753582 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aa41f3-18e0-4d80-bf1f-a2a619f2827c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:34:04.795007 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a347f0-f8cb-4a48-99aa-113d05ce5b93 None None] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:34:04.804554 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.auth.core [None req-93aa41f3-18e0-4d80-bf1f-a2a619f2827c None None] MFA Rules not processed for user `0ab73abe1c6e4b25a17281f4cd8e97e9`. Rule list: `[]` (Enabled: `True`). {{(pid=88081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:34:04.806834 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.fernet_utils [None req-93aa41f3-18e0-4d80-bf1f-a2a619f2827c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:34:04.818077 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 600/1205] 10.222.0.18 () {58 vars in 1058 bytes} [Sat Sep 24 19:34:04 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 19:34:04.827006 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb85016-4409-41fe-bc15-8be3b7aa75d7 None None] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:34:04.827375 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb85016-4409-41fe-bc15-8be3b7aa75d7 None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:34:04.827651 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb85016-4409-41fe-bc15-8be3b7aa75d7 None None] PATH_INFO: `/` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:34:04.832969 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 601/1206] 10.222.0.18 () {54 vars in 912 bytes} [Sat Sep 24 19:34:04 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:34:04.839262 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac134d5c-b6a8-4047-ae45-5d5c6905a599 None None] REQUEST_METHOD: `POST` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:34:04.840278 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac134d5c-b6a8-4047-ae45-5d5c6905a599 None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:34:04.841069 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac134d5c-b6a8-4047-ae45-5d5c6905a599 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:34:04.888669 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.auth.core [None req-ac134d5c-b6a8-4047-ae45-5d5c6905a599 None None] MFA Rules not processed for user `0ab73abe1c6e4b25a17281f4cd8e97e9`. Rule list: `[]` (Enabled: `True`). {{(pid=88081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:34:04.889937 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.fernet_utils [None req-ac134d5c-b6a8-4047-ae45-5d5c6905a599 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:34:04.913571 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 602/1207] 10.222.0.18 () {58 vars in 1009 bytes} [Sat Sep 24 19:34:04 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 19:34:04.921712 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac134d5c-b6a8-4047-ae45-5d5c6905a599 None None] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:34:04.944107 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a347f0-f8cb-4a48-99aa-113d05ce5b93 None None] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:34:04.949873 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac134d5c-b6a8-4047-ae45-5d5c6905a599 None None] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:34:04.954333 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e98f7d-d60c-432e-8df9-e9c3f493125e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ef291c173794b49ade9469a5ef72e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dfa5c2c17244006bdd629ec81553f1a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:34:04.955025 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f006d4c1-58b0-4b57-b298-69d7f2aba97e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2dfc6ff4e9b4d30b28d39d678b19896', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dfa5c2c17244006bdd629ec81553f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:34:04.955698 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e98f7d-d60c-432e-8df9-e9c3f493125e service neutron] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:34:04.955946 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e98f7d-d60c-432e-8df9-e9c3f493125e service neutron] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:34:04.956240 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f006d4c1-58b0-4b57-b298-69d7f2aba97e service placement] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:34:04.956381 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e98f7d-d60c-432e-8df9-e9c3f493125e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:34:04.956602 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f006d4c1-58b0-4b57-b298-69d7f2aba97e service placement] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:34:04.956912 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f006d4c1-58b0-4b57-b298-69d7f2aba97e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:34:04.965678 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=100 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:34:04.966719 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.fernet_utils [None req-f006d4c1-58b0-4b57-b298-69d7f2aba97e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:34:04.975115 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e98f7d-d60c-432e-8df9-e9c3f493125e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:34:04.976793 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e98f7d-d60c-432e-8df9-e9c3f493125e service neutron] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:34:04.988070 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f006d4c1-58b0-4b57-b298-69d7f2aba97e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:34:04.989847 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f006d4c1-58b0-4b57-b298-69d7f2aba97e service placement] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:34:05.019194 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 603/1208] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Sep 24 19:34:04 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:34:05.025338 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 606/1209] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Sep 24 19:34:04 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 24 19:34:14.795493 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4580dda-7434-495b-a0cc-3def7ae22f84 None None] REQUEST_METHOD: `POST` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:34:14.796035 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4580dda-7434-495b-a0cc-3def7ae22f84 None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:34:14.796035 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4580dda-7434-495b-a0cc-3def7ae22f84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:34:14.816435 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.auth.core [None req-f4580dda-7434-495b-a0cc-3def7ae22f84 None None] MFA Rules not processed for user `2ef291c173794b49ade9469a5ef72e08`. Rule list: `[]` (Enabled: `True`). {{(pid=88081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:34:14.817618 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.fernet_utils [None req-f4580dda-7434-495b-a0cc-3def7ae22f84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:34:14.824252 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 604/1210] 10.222.0.26 () {58 vars in 1015 bytes} [Sat Sep 24 19:34:14 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:34:14.842819 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f006d4c1-58b0-4b57-b298-69d7f2aba97e service placement] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:34:14.852651 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f006d4c1-58b0-4b57-b298-69d7f2aba97e service placement] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:34:14.856350 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b882321-756a-4370-9db2-34b431334f48 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ef291c173794b49ade9469a5ef72e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dfa5c2c17244006bdd629ec81553f1a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:34:14.857026 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b882321-756a-4370-9db2-34b431334f48 service neutron] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:34:14.857369 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b882321-756a-4370-9db2-34b431334f48 service neutron] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:34:14.857729 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b882321-756a-4370-9db2-34b431334f48 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:34:14.865441 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b882321-756a-4370-9db2-34b431334f48 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:34:14.866986 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b882321-756a-4370-9db2-34b431334f48 service neutron] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:34:14.870458 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=100 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:34:14.889767 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 607/1211] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Sep 24 19:34:14 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:34:15.862204 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99357e7a-a0af-4834-8dc6-82a07ed4f465 None None] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:34:15.862788 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99357e7a-a0af-4834-8dc6-82a07ed4f465 None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:34:15.863519 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99357e7a-a0af-4834-8dc6-82a07ed4f465 None None] PATH_INFO: `/` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:34:15.865064 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 605/1212] 10.222.0.18 () {54 vars in 921 bytes} [Sat Sep 24 19:34:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:34:15.923700 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6497a11-43d9-4507-a6e3-c7bc93780d83 None None] REQUEST_METHOD: `POST` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:34:15.924276 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6497a11-43d9-4507-a6e3-c7bc93780d83 None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:34:15.924276 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6497a11-43d9-4507-a6e3-c7bc93780d83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:34:15.974166 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.auth.core [None req-a6497a11-43d9-4507-a6e3-c7bc93780d83 None None] MFA Rules not processed for user `0ab73abe1c6e4b25a17281f4cd8e97e9`. Rule list: `[]` (Enabled: `True`). {{(pid=88080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:34:15.975606 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.fernet_utils [None req-a6497a11-43d9-4507-a6e3-c7bc93780d83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:34:15.987365 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 608/1213] 10.222.0.18 () {58 vars in 1018 bytes} [Sat Sep 24 19:34:15 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 19:34:16.050700 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99357e7a-a0af-4834-8dc6-82a07ed4f465 None None] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:34:16.077018 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99357e7a-a0af-4834-8dc6-82a07ed4f465 None None] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:34:16.084983 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5c4012-7554-4674-8674-0853fa77eda9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ab73abe1c6e4b25a17281f4cd8e97e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dfa5c2c17244006bdd629ec81553f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:34:16.085767 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5c4012-7554-4674-8674-0853fa77eda9 service nova] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:34:16.086171 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5c4012-7554-4674-8674-0853fa77eda9 service nova] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:34:16.086553 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5c4012-7554-4674-8674-0853fa77eda9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:34:16.098011 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5c4012-7554-4674-8674-0853fa77eda9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:34:16.099480 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5c4012-7554-4674-8674-0853fa77eda9 service nova] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:34:16.113541 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 606/1214] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Sep 24 19:34:16 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:34:22.187349 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0caf97-bece-471b-a6e7-87468d3dac50 None None] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:34:22.187938 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0caf97-bece-471b-a6e7-87468d3dac50 None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:34:22.188434 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0caf97-bece-471b-a6e7-87468d3dac50 None None] PATH_INFO: `/` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:34:22.195553 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 609/1215] 10.222.0.18 () {54 vars in 921 bytes} [Sat Sep 24 19:34:22 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:34:22.216192 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8274d91-65ce-4853-bb5e-acf2a4bbd372 None None] REQUEST_METHOD: `POST` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:34:22.216772 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8274d91-65ce-4853-bb5e-acf2a4bbd372 None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:34:22.217168 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8274d91-65ce-4853-bb5e-acf2a4bbd372 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:34:22.244444 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.auth.core [None req-c8274d91-65ce-4853-bb5e-acf2a4bbd372 None None] MFA Rules not processed for user `0ab73abe1c6e4b25a17281f4cd8e97e9`. Rule list: `[]` (Enabled: `True`). {{(pid=88081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:34:22.246182 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.fernet_utils [None req-c8274d91-65ce-4853-bb5e-acf2a4bbd372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:34:22.255419 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 607/1216] 10.222.0.18 () {58 vars in 1018 bytes} [Sat Sep 24 19:34:22 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:34:22.272913 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0caf97-bece-471b-a6e7-87468d3dac50 None None] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:34:22.287538 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0caf97-bece-471b-a6e7-87468d3dac50 None None] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:34:22.293415 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e96ed3e-6baa-4ec4-bb37-ee3907e85543 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ab73abe1c6e4b25a17281f4cd8e97e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dfa5c2c17244006bdd629ec81553f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:34:22.294105 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e96ed3e-6baa-4ec4-bb37-ee3907e85543 service nova] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:34:22.294327 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e96ed3e-6baa-4ec4-bb37-ee3907e85543 service nova] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:34:22.294594 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e96ed3e-6baa-4ec4-bb37-ee3907e85543 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:34:22.303973 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e96ed3e-6baa-4ec4-bb37-ee3907e85543 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:34:22.305542 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e96ed3e-6baa-4ec4-bb37-ee3907e85543 service nova] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:34:22.315234 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 610/1217] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Sep 24 19:34:22 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:34:32.234211 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=15 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:34:32.311244 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=10 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:34:33.386962 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8274d91-65ce-4853-bb5e-acf2a4bbd372 None None] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:34:33.396799 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8274d91-65ce-4853-bb5e-acf2a4bbd372 None None] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:34:33.401358 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c29fbc1-3239-495b-bac9-2e1a3c95a6fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ef291c173794b49ade9469a5ef72e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dfa5c2c17244006bdd629ec81553f1a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:34:33.402319 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c29fbc1-3239-495b-bac9-2e1a3c95a6fa service neutron] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:34:33.402757 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c29fbc1-3239-495b-bac9-2e1a3c95a6fa service neutron] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:34:33.403039 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c29fbc1-3239-495b-bac9-2e1a3c95a6fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:34:33.417334 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c29fbc1-3239-495b-bac9-2e1a3c95a6fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:34:33.419066 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c29fbc1-3239-495b-bac9-2e1a3c95a6fa service neutron] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:34:33.430456 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 608/1218] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Sep 24 19:34:33 2022] GET /identity/v3/auth/tokens => generated 2887 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:34:43.425889 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=6 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:34:54.949587 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274d73a4-a9a9-4952-93d8-49d504c6a976 None None] REQUEST_METHOD: `POST` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:34:54.950224 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274d73a4-a9a9-4952-93d8-49d504c6a976 None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:34:54.950224 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274d73a4-a9a9-4952-93d8-49d504c6a976 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:34:54.970370 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.auth.core [None req-274d73a4-a9a9-4952-93d8-49d504c6a976 None None] MFA Rules not processed for user `2aa8e7afc84049d7a339e6e584eeb71a`. Rule list: `[]` (Enabled: `True`). {{(pid=88080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:34:54.971741 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.fernet_utils [None req-274d73a4-a9a9-4952-93d8-49d504c6a976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:34:54.978658 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 611/1219] 10.222.0.18 () {58 vars in 958 bytes} [Sat Sep 24 19:34:54 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 19:34:55.448882 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ebd2bf-b8b2-4bfe-9c7b-0395af18a11b None None] REQUEST_METHOD: `POST` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:34:55.449417 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ebd2bf-b8b2-4bfe-9c7b-0395af18a11b None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:34:55.449417 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ebd2bf-b8b2-4bfe-9c7b-0395af18a11b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:34:55.468859 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.auth.core [None req-35ebd2bf-b8b2-4bfe-9c7b-0395af18a11b None None] MFA Rules not processed for user `2ef291c173794b49ade9469a5ef72e08`. Rule list: `[]` (Enabled: `True`). {{(pid=88081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:34:55.470069 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.fernet_utils [None req-35ebd2bf-b8b2-4bfe-9c7b-0395af18a11b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:34:55.476405 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 609/1220] 10.222.0.18 () {58 vars in 1009 bytes} [Sat Sep 24 19:34:55 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:34:55.487387 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274d73a4-a9a9-4952-93d8-49d504c6a976 None None] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:34:55.497000 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274d73a4-a9a9-4952-93d8-49d504c6a976 None None] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:34:55.501020 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3a27f3-6e79-4eb4-9707-03b255b8dbe3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ef291c173794b49ade9469a5ef72e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dfa5c2c17244006bdd629ec81553f1a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:34:55.501604 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3a27f3-6e79-4eb4-9707-03b255b8dbe3 service neutron] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:34:55.501903 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3a27f3-6e79-4eb4-9707-03b255b8dbe3 service neutron] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:34:55.502168 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3a27f3-6e79-4eb4-9707-03b255b8dbe3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:34:55.509082 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3a27f3-6e79-4eb4-9707-03b255b8dbe3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:34:55.510509 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3a27f3-6e79-4eb4-9707-03b255b8dbe3 service neutron] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:34:55.518479 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 612/1221] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Sep 24 19:34:55 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:35:05.464226 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=3 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:35:05.514704 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=9 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:35:19.263523 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934bb09a-472a-4bf3-9c86-fdbba2f34d7f None None] REQUEST_METHOD: `POST` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:35:19.264031 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934bb09a-472a-4bf3-9c86-fdbba2f34d7f None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:35:19.264031 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934bb09a-472a-4bf3-9c86-fdbba2f34d7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:35:19.283650 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.auth.core [None req-934bb09a-472a-4bf3-9c86-fdbba2f34d7f None None] MFA Rules not processed for user `2aa8e7afc84049d7a339e6e584eeb71a`. Rule list: `[]` (Enabled: `True`). {{(pid=88081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:35:19.284803 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.fernet_utils [None req-934bb09a-472a-4bf3-9c86-fdbba2f34d7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:35:19.291459 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 610/1222] 10.222.0.18 () {58 vars in 958 bytes} [Sat Sep 24 19:35:19 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:35:29.278424 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=3 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:35:32.765122 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc66a26-330c-4540-a4d8-44679ee1d19c None None] REQUEST_METHOD: `POST` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:35:32.765570 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc66a26-330c-4540-a4d8-44679ee1d19c None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:35:32.765661 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc66a26-330c-4540-a4d8-44679ee1d19c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:35:32.785706 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.auth.core [None req-ddc66a26-330c-4540-a4d8-44679ee1d19c None None] MFA Rules not processed for user `2aa8e7afc84049d7a339e6e584eeb71a`. Rule list: `[]` (Enabled: `True`). {{(pid=88080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:35:32.786667 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.fernet_utils [None req-ddc66a26-330c-4540-a4d8-44679ee1d19c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:35:32.793983 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 613/1223] 10.222.0.18 () {58 vars in 958 bytes} [Sat Sep 24 19:35:32 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:35:42.780413 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=3 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:36:31.001116 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350d64b2-20ee-4cbb-8300-63bb46d03e3b None None] REQUEST_METHOD: `POST` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:36:31.001694 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350d64b2-20ee-4cbb-8300-63bb46d03e3b None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:36:31.001694 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350d64b2-20ee-4cbb-8300-63bb46d03e3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:36:31.023418 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.auth.core [None req-350d64b2-20ee-4cbb-8300-63bb46d03e3b None None] MFA Rules not processed for user `2aa8e7afc84049d7a339e6e584eeb71a`. Rule list: `[]` (Enabled: `True`). {{(pid=88081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:36:31.024620 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.fernet_utils [None req-350d64b2-20ee-4cbb-8300-63bb46d03e3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:36:31.032594 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 611/1224] 10.222.0.18 () {58 vars in 958 bytes} [Sat Sep 24 19:36:30 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:36:41.017858 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=3 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:36:43.026044 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc66a26-330c-4540-a4d8-44679ee1d19c None None] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:36:43.046556 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc66a26-330c-4540-a4d8-44679ee1d19c None None] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:36:43.050150 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c065470c-eddd-4cd9-8b8c-6e0f3f59540d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ef291c173794b49ade9469a5ef72e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dfa5c2c17244006bdd629ec81553f1a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:36:43.050869 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c065470c-eddd-4cd9-8b8c-6e0f3f59540d service neutron] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:36:43.051146 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c065470c-eddd-4cd9-8b8c-6e0f3f59540d service neutron] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:36:43.051410 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c065470c-eddd-4cd9-8b8c-6e0f3f59540d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:36:43.060795 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c065470c-eddd-4cd9-8b8c-6e0f3f59540d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:36:43.062251 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c065470c-eddd-4cd9-8b8c-6e0f3f59540d service neutron] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:36:43.072284 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 614/1225] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Sep 24 19:36:43 2022] GET /identity/v3/auth/tokens => generated 2883 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:36:53.067675 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=10 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:37:00.180999 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350d64b2-20ee-4cbb-8300-63bb46d03e3b None None] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:37:00.203441 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350d64b2-20ee-4cbb-8300-63bb46d03e3b None None] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:37:00.208907 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d86e38d-04b3-4597-af6b-a08f2eda5dbd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2dfc6ff4e9b4d30b28d39d678b19896', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dfa5c2c17244006bdd629ec81553f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:37:00.209507 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d86e38d-04b3-4597-af6b-a08f2eda5dbd service placement] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:37:00.209805 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d86e38d-04b3-4597-af6b-a08f2eda5dbd service placement] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:37:00.210094 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d86e38d-04b3-4597-af6b-a08f2eda5dbd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:37:00.219473 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d86e38d-04b3-4597-af6b-a08f2eda5dbd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:37:00.221036 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d86e38d-04b3-4597-af6b-a08f2eda5dbd service placement] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:37:00.231621 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 612/1226] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Sep 24 19:37:00 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:37:10.227191 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=10 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:12.618211 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f627983a-bef5-41a0-b70d-c540300a41a8 None None] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:12.618790 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f627983a-bef5-41a0-b70d-c540300a41a8 None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:12.618790 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f627983a-bef5-41a0-b70d-c540300a41a8 None None] PATH_INFO: `/` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:12.620077 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 615/1227] 10.222.0.18 () {54 vars in 921 bytes} [Sat Sep 24 19:38:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:38:12.625392 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b52905-a67f-40ae-8028-15dda0a03ced None None] REQUEST_METHOD: `POST` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:12.626289 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b52905-a67f-40ae-8028-15dda0a03ced None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:12.626572 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b52905-a67f-40ae-8028-15dda0a03ced None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:12.683514 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.auth.core [None req-00b52905-a67f-40ae-8028-15dda0a03ced None None] MFA Rules not processed for user `0ab73abe1c6e4b25a17281f4cd8e97e9`. Rule list: `[]` (Enabled: `True`). {{(pid=88081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:38:12.684889 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.fernet_utils [None req-00b52905-a67f-40ae-8028-15dda0a03ced None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:38:12.704981 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 613/1228] 10.222.0.18 () {58 vars in 1018 bytes} [Sat Sep 24 19:38:12 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:38:12.717640 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f627983a-bef5-41a0-b70d-c540300a41a8 None None] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:12.734901 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f627983a-bef5-41a0-b70d-c540300a41a8 None None] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:12.740894 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7c2d5e-4c0d-48de-80ce-724f33cc0bc9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ab73abe1c6e4b25a17281f4cd8e97e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dfa5c2c17244006bdd629ec81553f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:12.741769 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7c2d5e-4c0d-48de-80ce-724f33cc0bc9 service nova] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:12.742223 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7c2d5e-4c0d-48de-80ce-724f33cc0bc9 service nova] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:12.743353 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7c2d5e-4c0d-48de-80ce-724f33cc0bc9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:12.753389 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7c2d5e-4c0d-48de-80ce-724f33cc0bc9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:12.756032 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7c2d5e-4c0d-48de-80ce-724f33cc0bc9 service nova] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:12.767991 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 616/1229] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Sep 24 19:38:12 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 24 19:38:22.702164 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=17 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:22.763270 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=6 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:26.375283 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5089aff-43c8-429d-be59-263756622546 None None] REQUEST_METHOD: `POST` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:26.375841 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5089aff-43c8-429d-be59-263756622546 None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:26.375841 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5089aff-43c8-429d-be59-263756622546 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:26.396276 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.auth.core [None req-c5089aff-43c8-429d-be59-263756622546 None None] MFA Rules not processed for user `0c9fa234c1ce4191b1291c92e25557ed`. Rule list: `[]` (Enabled: `True`). {{(pid=88081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:38:26.397473 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.fernet_utils [None req-c5089aff-43c8-429d-be59-263756622546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:38:26.404817 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 614/1230] 10.222.0.18 () {58 vars in 958 bytes} [Sat Sep 24 19:38:26 2022] POST /identity/v3/auth/tokens => generated 2820 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:38:36.391603 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=3 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:38:52.796062 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7c2d5e-4c0d-48de-80ce-724f33cc0bc9 service nova] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:52.865664 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7c2d5e-4c0d-48de-80ce-724f33cc0bc9 service nova] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:52.869430 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab32c80-1040-42ef-ac70-6df7d49a6869 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd2db56b901e4fb08a0ec849cc9136f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dfa5c2c17244006bdd629ec81553f1a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:52.870075 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab32c80-1040-42ef-ac70-6df7d49a6869 service cinder] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:52.870355 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab32c80-1040-42ef-ac70-6df7d49a6869 service cinder] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:52.870629 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab32c80-1040-42ef-ac70-6df7d49a6869 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:52.879663 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab32c80-1040-42ef-ac70-6df7d49a6869 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:52.881112 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab32c80-1040-42ef-ac70-6df7d49a6869 service cinder] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:52.890620 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 617/1231] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Sep 24 19:38:52 2022] GET /identity/v3/auth/tokens => generated 2820 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:38:52.920362 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5089aff-43c8-429d-be59-263756622546 None None] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:38:52.934565 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5089aff-43c8-429d-be59-263756622546 None None] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:38:52.947366 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47299d2a-a2cd-4ec3-8cc9-016f9433aaeb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ab73abe1c6e4b25a17281f4cd8e97e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dfa5c2c17244006bdd629ec81553f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:38:52.947366 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47299d2a-a2cd-4ec3-8cc9-016f9433aaeb service nova] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:52.947366 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47299d2a-a2cd-4ec3-8cc9-016f9433aaeb service nova] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:52.947366 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47299d2a-a2cd-4ec3-8cc9-016f9433aaeb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:52.951035 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47299d2a-a2cd-4ec3-8cc9-016f9433aaeb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:38:52.952926 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47299d2a-a2cd-4ec3-8cc9-016f9433aaeb service nova] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:38:52.965009 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 615/1232] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Sep 24 19:38:52 2022] GET /identity/v3/auth/tokens => generated 2816 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:38:55.567596 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4d09e9-308d-4e5a-a829-a98a8e9342de None None] REQUEST_METHOD: `POST` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:38:55.568424 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4d09e9-308d-4e5a-a829-a98a8e9342de None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:38:55.568852 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4d09e9-308d-4e5a-a829-a98a8e9342de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:38:55.599547 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.auth.core [None req-bb4d09e9-308d-4e5a-a829-a98a8e9342de None None] MFA Rules not processed for user `2aa8e7afc84049d7a339e6e584eeb71a`. Rule list: `[]` (Enabled: `True`). {{(pid=88080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:38:55.600815 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.fernet_utils [None req-bb4d09e9-308d-4e5a-a829-a98a8e9342de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:38:55.611805 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 618/1233] 10.222.0.18 () {58 vars in 958 bytes} [Sat Sep 24 19:38:55 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:39:02.959424 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=6 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:39:03.982984 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47299d2a-a2cd-4ec3-8cc9-016f9433aaeb service nova] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:03.992105 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47299d2a-a2cd-4ec3-8cc9-016f9433aaeb service nova] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:03.996122 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a876d5-f999-4a48-ab1a-42bcc87128a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ef291c173794b49ade9469a5ef72e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dfa5c2c17244006bdd629ec81553f1a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:03.996709 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a876d5-f999-4a48-ab1a-42bcc87128a2 service neutron] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:03.996983 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a876d5-f999-4a48-ab1a-42bcc87128a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:03.997252 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a876d5-f999-4a48-ab1a-42bcc87128a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:04.006385 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a876d5-f999-4a48-ab1a-42bcc87128a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:04.007785 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a876d5-f999-4a48-ab1a-42bcc87128a2 service neutron] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:04.018226 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 616/1234] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Sep 24 19:39:03 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:39:05.197298 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4d09e9-308d-4e5a-a829-a98a8e9342de None None] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:05.206512 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4d09e9-308d-4e5a-a829-a98a8e9342de None None] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:05.210114 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37cb8e1-8705-4066-af04-0ef4dfe94d2e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ef291c173794b49ade9469a5ef72e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dfa5c2c17244006bdd629ec81553f1a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:05.210705 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37cb8e1-8705-4066-af04-0ef4dfe94d2e service neutron] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:05.210977 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37cb8e1-8705-4066-af04-0ef4dfe94d2e service neutron] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:05.211244 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37cb8e1-8705-4066-af04-0ef4dfe94d2e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:05.221386 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37cb8e1-8705-4066-af04-0ef4dfe94d2e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:05.222757 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37cb8e1-8705-4066-af04-0ef4dfe94d2e service neutron] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:05.233872 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 619/1235] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Sep 24 19:39:05 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:39:14.014054 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=6 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:39:15.228607 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=39 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:39:20.379993 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a876d5-f999-4a48-ab1a-42bcc87128a2 service neutron] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:39:20.389400 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a876d5-f999-4a48-ab1a-42bcc87128a2 service neutron] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:39:20.393139 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7db3827-aca2-457f-9766-54e3adf6a21e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ef291c173794b49ade9469a5ef72e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dfa5c2c17244006bdd629ec81553f1a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:39:20.393732 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7db3827-aca2-457f-9766-54e3adf6a21e service neutron] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:39:20.394081 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7db3827-aca2-457f-9766-54e3adf6a21e service neutron] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:39:20.394350 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7db3827-aca2-457f-9766-54e3adf6a21e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:39:20.401532 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7db3827-aca2-457f-9766-54e3adf6a21e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:39:20.402969 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7db3827-aca2-457f-9766-54e3adf6a21e service neutron] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:39:20.410850 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 617/1236] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Sep 24 19:39:20 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 31 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:39:30.407366 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=6 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:40:05.833401 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37cb8e1-8705-4066-af04-0ef4dfe94d2e service neutron] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:40:05.854041 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37cb8e1-8705-4066-af04-0ef4dfe94d2e service neutron] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:40:05.860415 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abeef197-af09-4f3e-bbe1-8fd53e39c9d4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ab73abe1c6e4b25a17281f4cd8e97e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dfa5c2c17244006bdd629ec81553f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:40:05.861047 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeef197-af09-4f3e-bbe1-8fd53e39c9d4 service nova] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:40:05.861397 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeef197-af09-4f3e-bbe1-8fd53e39c9d4 service nova] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:40:05.861666 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeef197-af09-4f3e-bbe1-8fd53e39c9d4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:40:05.871520 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abeef197-af09-4f3e-bbe1-8fd53e39c9d4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:40:05.874635 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abeef197-af09-4f3e-bbe1-8fd53e39c9d4 service nova] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:40:05.896661 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 620/1237] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Sep 24 19:40:05 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:40:13.892627 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7db3827-aca2-457f-9766-54e3adf6a21e service neutron] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:40:13.901936 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7db3827-aca2-457f-9766-54e3adf6a21e service neutron] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:40:13.905478 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a170494d-8c7f-4c6d-800b-f5cc0621d817 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ef291c173794b49ade9469a5ef72e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dfa5c2c17244006bdd629ec81553f1a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:40:13.906103 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a170494d-8c7f-4c6d-800b-f5cc0621d817 service neutron] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:40:13.906380 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a170494d-8c7f-4c6d-800b-f5cc0621d817 service neutron] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:40:13.906649 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a170494d-8c7f-4c6d-800b-f5cc0621d817 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:40:13.966063 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a170494d-8c7f-4c6d-800b-f5cc0621d817 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:40:13.967479 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a170494d-8c7f-4c6d-800b-f5cc0621d817 service neutron] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:40:13.985695 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 618/1238] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Sep 24 19:40:13 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:40:15.880913 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=6 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:40:17.279065 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e864f95f-5819-4be5-975b-57212361df3e None None] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:40:17.279697 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e864f95f-5819-4be5-975b-57212361df3e None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:40:17.279697 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e864f95f-5819-4be5-975b-57212361df3e None None] PATH_INFO: `/` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:40:17.281246 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 621/1239] 10.222.0.18 () {54 vars in 921 bytes} [Sat Sep 24 19:40:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 24 19:40:17.289218 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf526efb-6026-42c7-ae7f-1e07f8255136 None None] REQUEST_METHOD: `POST` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:40:17.289726 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf526efb-6026-42c7-ae7f-1e07f8255136 None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:40:17.289822 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf526efb-6026-42c7-ae7f-1e07f8255136 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:40:17.348828 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.auth.core [None req-cf526efb-6026-42c7-ae7f-1e07f8255136 None None] MFA Rules not processed for user `f2dfc6ff4e9b4d30b28d39d678b19896`. Rule list: `[]` (Enabled: `True`). {{(pid=88081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:40:17.350078 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.fernet_utils [None req-cf526efb-6026-42c7-ae7f-1e07f8255136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:40:17.359756 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 619/1240] 10.222.0.18 () {58 vars in 1018 bytes} [Sat Sep 24 19:40:17 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:40:17.371123 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e864f95f-5819-4be5-975b-57212361df3e None None] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:40:17.384864 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e864f95f-5819-4be5-975b-57212361df3e None None] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:40:17.390228 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bed1a7-e4c5-4bc9-bcf6-384278c37f76 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2dfc6ff4e9b4d30b28d39d678b19896', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dfa5c2c17244006bdd629ec81553f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:40:17.390828 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bed1a7-e4c5-4bc9-bcf6-384278c37f76 service placement] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:40:17.391100 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bed1a7-e4c5-4bc9-bcf6-384278c37f76 service placement] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:40:17.391362 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bed1a7-e4c5-4bc9-bcf6-384278c37f76 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:40:17.400103 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bed1a7-e4c5-4bc9-bcf6-384278c37f76 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:40:17.402338 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bed1a7-e4c5-4bc9-bcf6-384278c37f76 service placement] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:40:17.412392 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 622/1241] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Sep 24 19:40:17 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:40:20.635591 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110307d1-2f47-42c4-8b86-7df971266b7c None None] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:40:20.636098 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110307d1-2f47-42c4-8b86-7df971266b7c None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:40:20.636098 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110307d1-2f47-42c4-8b86-7df971266b7c None None] PATH_INFO: `/` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:40:20.637445 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 620/1242] 10.222.0.18 () {54 vars in 921 bytes} [Sat Sep 24 19:40:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:40:20.647029 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833e4636-76b3-4841-a92b-5c658e0b1b58 None None] REQUEST_METHOD: `POST` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:40:20.647495 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833e4636-76b3-4841-a92b-5c658e0b1b58 None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:40:20.647608 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833e4636-76b3-4841-a92b-5c658e0b1b58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:40:20.667819 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.auth.core [None req-833e4636-76b3-4841-a92b-5c658e0b1b58 None None] MFA Rules not processed for user `f2dfc6ff4e9b4d30b28d39d678b19896`. Rule list: `[]` (Enabled: `True`). {{(pid=88080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:40:20.669039 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.fernet_utils [None req-833e4636-76b3-4841-a92b-5c658e0b1b58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:40:20.677596 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 623/1243] 10.222.0.18 () {58 vars in 1018 bytes} [Sat Sep 24 19:40:20 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:40:20.695599 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110307d1-2f47-42c4-8b86-7df971266b7c None None] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:40:20.714995 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833e4636-76b3-4841-a92b-5c658e0b1b58 None None] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:40:20.718693 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110307d1-2f47-42c4-8b86-7df971266b7c None None] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:40:20.724621 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccddee4-ef99-4a35-ad89-f102c87d3a9b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2dfc6ff4e9b4d30b28d39d678b19896', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dfa5c2c17244006bdd629ec81553f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:40:20.725237 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccddee4-ef99-4a35-ad89-f102c87d3a9b service placement] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:40:20.725702 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccddee4-ef99-4a35-ad89-f102c87d3a9b service placement] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:40:20.725818 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccddee4-ef99-4a35-ad89-f102c87d3a9b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:40:20.725952 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833e4636-76b3-4841-a92b-5c658e0b1b58 None None] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:40:20.733613 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fd4db4-2c0f-4269-988d-8023db54e119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fc67bd325c24a418945f738b4bd5c71', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:40:20.734292 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fd4db4-2c0f-4269-988d-8023db54e119 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:40:20.734565 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fd4db4-2c0f-4269-988d-8023db54e119 admin admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:40:20.734833 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fd4db4-2c0f-4269-988d-8023db54e119 admin admin] PATH_INFO: `/v3/users/0c9fa234c1ce4191b1291c92e25557ed` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:40:20.736053 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fd4db4-2c0f-4269-988d-8023db54e119 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c9fa234c1ce4191b1291c92e25557ed)` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:40:20.736326 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccddee4-ef99-4a35-ad89-f102c87d3a9b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:40:20.738015 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fd4db4-2c0f-4269-988d-8023db54e119 admin admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:40:20.738688 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccddee4-ef99-4a35-ad89-f102c87d3a9b service placement] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:40:20.748753 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 621/1244] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Sep 24 19:40:20 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:40:20.796562 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.notifications [None req-34fd4db4-2c0f-4269-988d-8023db54e119 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c9fa234c1ce4191b1291c92e25557ed'} {{(pid=88080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:40:20.797351 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.notifications [None req-34fd4db4-2c0f-4269-988d-8023db54e119 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c9fa234c1ce4191b1291c92e25557ed'} {{(pid=88080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:40:20.806256 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.notifications [None req-34fd4db4-2c0f-4269-988d-8023db54e119 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c9fa234c1ce4191b1291c92e25557ed'} {{(pid=88080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:40:20.807016 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.notifications [None req-34fd4db4-2c0f-4269-988d-8023db54e119 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c9fa234c1ce4191b1291c92e25557ed'} {{(pid=88080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:40:20.814604 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.notifications [None req-34fd4db4-2c0f-4269-988d-8023db54e119 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c9fa234c1ce4191b1291c92e25557ed'} {{(pid=88080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:40:20.851914 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 624/1245] 10.222.0.18 () {58 vars in 1224 bytes} [Sat Sep 24 19:40:20 2022] DELETE /identity/v3/users/0c9fa234c1ce4191b1291c92e25557ed => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 24 19:40:21.031834 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccddee4-ef99-4a35-ad89-f102c87d3a9b service placement] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:40:21.042911 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccddee4-ef99-4a35-ad89-f102c87d3a9b service placement] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:40:21.100881 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0f1ed5-0adc-47b4-a118-1750da7f1b06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fc67bd325c24a418945f738b4bd5c71', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:40:21.109089 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0f1ed5-0adc-47b4-a118-1750da7f1b06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:40:21.109089 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0f1ed5-0adc-47b4-a118-1750da7f1b06 admin admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:40:21.109089 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0f1ed5-0adc-47b4-a118-1750da7f1b06 admin admin] PATH_INFO: `/v3/projects/c9f9ab6ea7f64dc396a4daccfe52136b` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:40:21.109089 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0f1ed5-0adc-47b4-a118-1750da7f1b06 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9f9ab6ea7f64dc396a4daccfe52136b)` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:40:21.109089 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0f1ed5-0adc-47b4-a118-1750da7f1b06 admin admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:40:21.152054 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:40:21.156246 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.notifications [None req-5e0f1ed5-0adc-47b4-a118-1750da7f1b06 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9f9ab6ea7f64dc396a4daccfe52136b', 'request_id': 'req-5e0f1ed5-0adc-47b4-a118-1750da7f1b06'} {{(pid=88081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:40:21.163029 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.notifications [None req-5e0f1ed5-0adc-47b4-a118-1750da7f1b06 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9f9ab6ea7f64dc396a4daccfe52136b', 'request_id': 'req-5e0f1ed5-0adc-47b4-a118-1750da7f1b06'} {{(pid=88081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:40:21.171540 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.notifications [None req-5e0f1ed5-0adc-47b4-a118-1750da7f1b06 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9f9ab6ea7f64dc396a4daccfe52136b', 'request_id': 'req-5e0f1ed5-0adc-47b4-a118-1750da7f1b06'} {{(pid=88081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:40:21.183433 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.notifications [None req-5e0f1ed5-0adc-47b4-a118-1750da7f1b06 admin admin] The token cache is being invalidate because project c9f9ab6ea7f64dc396a4daccfe52136b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88081) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 19:40:21.183718 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.notifications [None req-5e0f1ed5-0adc-47b4-a118-1750da7f1b06 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:40:21.184883 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.notifications [None req-5e0f1ed5-0adc-47b4-a118-1750da7f1b06 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:40:21.185936 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 622/1246] 10.222.0.18 () {58 vars in 1233 bytes} [Sat Sep 24 19:40:21 2022] DELETE /identity/v3/projects/c9f9ab6ea7f64dc396a4daccfe52136b => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:40:21.189993 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fd4db4-2c0f-4269-988d-8023db54e119 admin admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:40:21.191525 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.fernet_utils [None req-34fd4db4-2c0f-4269-988d-8023db54e119 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:40:21.205219 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fd4db4-2c0f-4269-988d-8023db54e119 admin admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:40:21.263472 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061791fb-22fe-4bda-8b5a-f0df818f95cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fc67bd325c24a418945f738b4bd5c71', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:40:21.264344 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061791fb-22fe-4bda-8b5a-f0df818f95cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:40:21.264657 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061791fb-22fe-4bda-8b5a-f0df818f95cb admin admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:40:21.264931 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061791fb-22fe-4bda-8b5a-f0df818f95cb admin admin] PATH_INFO: `/v3/users/44ba37d04b1a4e6985858d750c51769f` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:40:21.266107 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061791fb-22fe-4bda-8b5a-f0df818f95cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=44ba37d04b1a4e6985858d750c51769f)` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:40:21.268028 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061791fb-22fe-4bda-8b5a-f0df818f95cb admin admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:40:21.312812 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.notifications [None req-061791fb-22fe-4bda-8b5a-f0df818f95cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44ba37d04b1a4e6985858d750c51769f'} {{(pid=88080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:40:21.313400 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.notifications [None req-061791fb-22fe-4bda-8b5a-f0df818f95cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44ba37d04b1a4e6985858d750c51769f'} {{(pid=88080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:40:21.319433 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:40:21.321820 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.notifications [None req-061791fb-22fe-4bda-8b5a-f0df818f95cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44ba37d04b1a4e6985858d750c51769f'} {{(pid=88080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:40:21.323135 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.notifications [None req-061791fb-22fe-4bda-8b5a-f0df818f95cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44ba37d04b1a4e6985858d750c51769f'} {{(pid=88080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:40:21.332400 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.notifications [None req-061791fb-22fe-4bda-8b5a-f0df818f95cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44ba37d04b1a4e6985858d750c51769f'} {{(pid=88080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:40:21.350096 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 625/1247] 10.222.0.18 () {58 vars in 1224 bytes} [Sat Sep 24 19:40:21 2022] DELETE /identity/v3/users/44ba37d04b1a4e6985858d750c51769f => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:40:21.524933 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0f1ed5-0adc-47b4-a118-1750da7f1b06 admin admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:40:21.526463 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.fernet_utils [None req-5e0f1ed5-0adc-47b4-a118-1750da7f1b06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:40:21.539159 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0f1ed5-0adc-47b4-a118-1750da7f1b06 admin admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:40:21.607372 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96238506-f94f-4c21-a7f9-b3e5eaea500e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fc67bd325c24a418945f738b4bd5c71', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:40:21.608001 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96238506-f94f-4c21-a7f9-b3e5eaea500e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:40:21.608279 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96238506-f94f-4c21-a7f9-b3e5eaea500e admin admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:40:21.608547 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96238506-f94f-4c21-a7f9-b3e5eaea500e admin admin] PATH_INFO: `/v3/projects/3f730135f9f54231b3f5c6eac8b324ee` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:40:21.609655 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96238506-f94f-4c21-a7f9-b3e5eaea500e admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f730135f9f54231b3f5c6eac8b324ee)` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:40:21.611589 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96238506-f94f-4c21-a7f9-b3e5eaea500e admin admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:40:21.658360 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.notifications [None req-96238506-f94f-4c21-a7f9-b3e5eaea500e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f730135f9f54231b3f5c6eac8b324ee', 'request_id': 'req-96238506-f94f-4c21-a7f9-b3e5eaea500e'} {{(pid=88081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:40:21.663656 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.notifications [None req-96238506-f94f-4c21-a7f9-b3e5eaea500e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f730135f9f54231b3f5c6eac8b324ee', 'request_id': 'req-96238506-f94f-4c21-a7f9-b3e5eaea500e'} {{(pid=88081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:40:21.671641 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.notifications [None req-96238506-f94f-4c21-a7f9-b3e5eaea500e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f730135f9f54231b3f5c6eac8b324ee', 'request_id': 'req-96238506-f94f-4c21-a7f9-b3e5eaea500e'} {{(pid=88081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:40:21.683618 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.notifications [None req-96238506-f94f-4c21-a7f9-b3e5eaea500e admin admin] The token cache is being invalidate because project 3f730135f9f54231b3f5c6eac8b324ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88081) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 19:40:21.683900 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.notifications [None req-96238506-f94f-4c21-a7f9-b3e5eaea500e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:40:21.684532 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.notifications [None req-96238506-f94f-4c21-a7f9-b3e5eaea500e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:40:21.686152 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 623/1248] 10.222.0.18 () {58 vars in 1233 bytes} [Sat Sep 24 19:40:21 2022] DELETE /identity/v3/projects/3f730135f9f54231b3f5c6eac8b324ee => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:40:31.346734 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=9,keystone:INSERT=1,keystone:DELETE=3 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:40:31.680318 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=59,keystone:DELETE=11,keystone:INSERT=2 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:40:52.237612 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8c7828-5dd0-40f7-91a1-275ccfb997e5 None None] REQUEST_METHOD: `POST` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:40:52.238161 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8c7828-5dd0-40f7-91a1-275ccfb997e5 None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:40:52.238258 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8c7828-5dd0-40f7-91a1-275ccfb997e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:40:52.266278 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.auth.core [None req-4c8c7828-5dd0-40f7-91a1-275ccfb997e5 None None] MFA Rules not processed for user `2aa8e7afc84049d7a339e6e584eeb71a`. Rule list: `[]` (Enabled: `True`). {{(pid=88080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:40:52.267455 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.fernet_utils [None req-4c8c7828-5dd0-40f7-91a1-275ccfb997e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:40:52.335680 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 626/1249] 10.222.0.18 () {58 vars in 958 bytes} [Sat Sep 24 19:40:52 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:40:52.655710 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96238506-f94f-4c21-a7f9-b3e5eaea500e admin admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:40:52.657189 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.fernet_utils [None req-96238506-f94f-4c21-a7f9-b3e5eaea500e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:40:52.716304 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96238506-f94f-4c21-a7f9-b3e5eaea500e admin admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:40:52.719796 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b59f47-87c5-4076-8922-f444935f99f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ef291c173794b49ade9469a5ef72e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dfa5c2c17244006bdd629ec81553f1a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:40:52.720414 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b59f47-87c5-4076-8922-f444935f99f6 service neutron] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:40:52.720686 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b59f47-87c5-4076-8922-f444935f99f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:40:52.720953 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b59f47-87c5-4076-8922-f444935f99f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:40:52.722671 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.fernet_utils [None req-c0b59f47-87c5-4076-8922-f444935f99f6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:40:52.732412 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b59f47-87c5-4076-8922-f444935f99f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:40:52.733844 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b59f47-87c5-4076-8922-f444935f99f6 service neutron] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:40:52.741630 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 624/1250] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Sep 24 19:40:52 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:40:53.184268 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8c7828-5dd0-40f7-91a1-275ccfb997e5 None None] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:40:53.185646 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.fernet_utils [None req-4c8c7828-5dd0-40f7-91a1-275ccfb997e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:40:53.266676 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8c7828-5dd0-40f7-91a1-275ccfb997e5 None None] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:40:53.271655 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6829047-e14c-4084-b968-8489807d6d92 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2dfc6ff4e9b4d30b28d39d678b19896', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dfa5c2c17244006bdd629ec81553f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:40:53.272258 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6829047-e14c-4084-b968-8489807d6d92 service placement] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:40:53.272532 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6829047-e14c-4084-b968-8489807d6d92 service placement] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:40:53.272799 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6829047-e14c-4084-b968-8489807d6d92 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:40:53.275147 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.fernet_utils [None req-b6829047-e14c-4084-b968-8489807d6d92 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:40:53.286043 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6829047-e14c-4084-b968-8489807d6d92 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:40:53.287594 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6829047-e14c-4084-b968-8489807d6d92 service placement] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:40:53.296959 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 627/1251] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Sep 24 19:40:53 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:41:01.927305 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b59f47-87c5-4076-8922-f444935f99f6 service neutron] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:41:01.928456 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.fernet_utils [None req-c0b59f47-87c5-4076-8922-f444935f99f6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:41:02.008871 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b59f47-87c5-4076-8922-f444935f99f6 service neutron] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:41:02.014028 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f44113-7cb2-4e9c-99a8-7c8f201a1218 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ab73abe1c6e4b25a17281f4cd8e97e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dfa5c2c17244006bdd629ec81553f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:41:02.014582 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f44113-7cb2-4e9c-99a8-7c8f201a1218 service nova] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:41:02.015138 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f44113-7cb2-4e9c-99a8-7c8f201a1218 service nova] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:41:02.015419 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f44113-7cb2-4e9c-99a8-7c8f201a1218 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:41:02.017190 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.fernet_utils [None req-43f44113-7cb2-4e9c-99a8-7c8f201a1218 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:41:02.029516 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f44113-7cb2-4e9c-99a8-7c8f201a1218 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:41:02.031183 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f44113-7cb2-4e9c-99a8-7c8f201a1218 service nova] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:41:02.041747 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 625/1252] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Sep 24 19:41:01 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:41:03.293044 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=72 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:41:12.037016 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=60 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:42:04.217988 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf6e024-a823-4b4d-a37d-a25457c936d7 None None] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:42:04.218444 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf6e024-a823-4b4d-a37d-a25457c936d7 None None] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:42:04.218543 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf6e024-a823-4b4d-a37d-a25457c936d7 None None] PATH_INFO: `/` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:42:04.219834 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 628/1253] 10.222.0.18 () {54 vars in 961 bytes} [Sat Sep 24 19:42:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 19:42:04.224637 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a7cc42-3cf6-4d10-967c-bcbc5c123bbc None None] REQUEST_METHOD: `POST` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:42:04.225109 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a7cc42-3cf6-4d10-967c-bcbc5c123bbc None None] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:42:04.225215 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a7cc42-3cf6-4d10-967c-bcbc5c123bbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:42:04.255177 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.auth.core [None req-40a7cc42-3cf6-4d10-967c-bcbc5c123bbc None None] MFA Rules not processed for user `f2dfc6ff4e9b4d30b28d39d678b19896`. Rule list: `[]` (Enabled: `True`). {{(pid=88081) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 19:42:04.256345 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.fernet_utils [None req-40a7cc42-3cf6-4d10-967c-bcbc5c123bbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:42:04.281231 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 626/1254] 10.222.0.18 () {58 vars in 1058 bytes} [Sat Sep 24 19:42:04 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 19:42:04.288617 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf6e024-a823-4b4d-a37d-a25457c936d7 None None] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:42:04.303009 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf6e024-a823-4b4d-a37d-a25457c936d7 None None] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:42:04.308078 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20ac9dd-1027-452a-a193-9762c777668b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2dfc6ff4e9b4d30b28d39d678b19896', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dfa5c2c17244006bdd629ec81553f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:42:04.308721 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20ac9dd-1027-452a-a193-9762c777668b service placement] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:42:04.308995 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20ac9dd-1027-452a-a193-9762c777668b service placement] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:42:04.309263 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20ac9dd-1027-452a-a193-9762c777668b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:42:04.311054 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.fernet_utils [None req-b20ac9dd-1027-452a-a193-9762c777668b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:42:04.323650 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20ac9dd-1027-452a-a193-9762c777668b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:42:04.325499 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20ac9dd-1027-452a-a193-9762c777668b service placement] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:42:04.338539 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 629/1255] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Sep 24 19:42:04 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:42:14.274656 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=14 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:42:14.333062 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=6 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:43:24.829734 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a7cc42-3cf6-4d10-967c-bcbc5c123bbc None None] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:43:24.842290 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a7cc42-3cf6-4d10-967c-bcbc5c123bbc None None] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:43:24.848008 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ff9716-fa3c-4b91-a540-f8c2d0628f95 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ab73abe1c6e4b25a17281f4cd8e97e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dfa5c2c17244006bdd629ec81553f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:43:24.848944 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ff9716-fa3c-4b91-a540-f8c2d0628f95 service nova] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:43:24.849248 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ff9716-fa3c-4b91-a540-f8c2d0628f95 service nova] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:43:24.849549 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ff9716-fa3c-4b91-a540-f8c2d0628f95 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:43:24.851503 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.fernet_utils [None req-a7ff9716-fa3c-4b91-a540-f8c2d0628f95 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:43:24.864565 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ff9716-fa3c-4b91-a540-f8c2d0628f95 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:43:24.866330 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ff9716-fa3c-4b91-a540-f8c2d0628f95 service nova] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:43:24.876750 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 627/1256] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Sep 24 19:43:24 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:43:29.245076 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20ac9dd-1027-452a-a193-9762c777668b service placement] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:43:29.254063 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20ac9dd-1027-452a-a193-9762c777668b service placement] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:43:29.257540 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d3b5af-f200-402e-a7d6-26fa4396c4e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ef291c173794b49ade9469a5ef72e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dfa5c2c17244006bdd629ec81553f1a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:43:29.258212 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d3b5af-f200-402e-a7d6-26fa4396c4e4 service neutron] REQUEST_METHOD: `GET` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:43:29.258430 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d3b5af-f200-402e-a7d6-26fa4396c4e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:43:29.258692 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d3b5af-f200-402e-a7d6-26fa4396c4e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:43:29.260389 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.fernet_utils [None req-98d3b5af-f200-402e-a7d6-26fa4396c4e4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:43:29.341890 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d3b5af-f200-402e-a7d6-26fa4396c4e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:43:29.343313 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d3b5af-f200-402e-a7d6-26fa4396c4e4 service neutron] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:43:29.354483 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 630/1257] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Sep 24 19:43:29 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:43:34.873242 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=6 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:43:35.352083 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ff9716-fa3c-4b91-a540-f8c2d0628f95 service nova] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:43:35.354284 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.fernet_utils [None req-a7ff9716-fa3c-4b91-a540-f8c2d0628f95 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:43:35.373984 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ff9716-fa3c-4b91-a540-f8c2d0628f95 service nova] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:43:35.378957 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dd0eb3-9e85-4140-a732-8d8ef2c59825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fc67bd325c24a418945f738b4bd5c71', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:43:35.379587 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dd0eb3-9e85-4140-a732-8d8ef2c59825 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:43:35.379854 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dd0eb3-9e85-4140-a732-8d8ef2c59825 admin admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:43:35.380128 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dd0eb3-9e85-4140-a732-8d8ef2c59825 admin admin] PATH_INFO: `/v3/users/2aa8e7afc84049d7a339e6e584eeb71a` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:43:35.381229 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dd0eb3-9e85-4140-a732-8d8ef2c59825 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2aa8e7afc84049d7a339e6e584eeb71a)` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:43:35.382249 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: WARNING py.warnings [None req-f9dd0eb3-9e85-4140-a732-8d8ef2c59825 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 24 19:43:35.382249 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: warnings.warn(msg) Sep 24 19:43:35.382249 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: Sep 24 19:43:35.383441 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dd0eb3-9e85-4140-a732-8d8ef2c59825 admin admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:43:35.444578 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.notifications [None req-f9dd0eb3-9e85-4140-a732-8d8ef2c59825 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2aa8e7afc84049d7a339e6e584eeb71a'} {{(pid=88081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:43:35.445313 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.notifications [None req-f9dd0eb3-9e85-4140-a732-8d8ef2c59825 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2aa8e7afc84049d7a339e6e584eeb71a'} {{(pid=88081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:43:35.446018 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.notifications [None req-f9dd0eb3-9e85-4140-a732-8d8ef2c59825 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2aa8e7afc84049d7a339e6e584eeb71a'} {{(pid=88081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:43:35.454147 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.notifications [None req-f9dd0eb3-9e85-4140-a732-8d8ef2c59825 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2aa8e7afc84049d7a339e6e584eeb71a'} {{(pid=88081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:43:35.465951 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.notifications [None req-f9dd0eb3-9e85-4140-a732-8d8ef2c59825 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2aa8e7afc84049d7a339e6e584eeb71a'} {{(pid=88081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:43:35.490418 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 628/1258] 10.222.0.18 () {58 vars in 1224 bytes} [Sat Sep 24 19:43:35 2022] DELETE /identity/v3/users/2aa8e7afc84049d7a339e6e584eeb71a => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:43:35.676408 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d3b5af-f200-402e-a7d6-26fa4396c4e4 service neutron] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:43:35.688960 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d3b5af-f200-402e-a7d6-26fa4396c4e4 service neutron] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:43:35.749183 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38296170-947f-4a15-a6bf-ca918edd92cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fc67bd325c24a418945f738b4bd5c71', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:43:35.749810 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38296170-947f-4a15-a6bf-ca918edd92cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:43:35.750116 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38296170-947f-4a15-a6bf-ca918edd92cc admin admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:43:35.750383 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38296170-947f-4a15-a6bf-ca918edd92cc admin admin] PATH_INFO: `/v3/projects/01809e3784b941869911443a3d0cd044` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:43:35.751478 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38296170-947f-4a15-a6bf-ca918edd92cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=01809e3784b941869911443a3d0cd044)` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:43:35.753028 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: WARNING py.warnings [None req-38296170-947f-4a15-a6bf-ca918edd92cc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 24 19:43:35.753028 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: warnings.warn(msg) Sep 24 19:43:35.753028 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: Sep 24 19:43:35.754304 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38296170-947f-4a15-a6bf-ca918edd92cc admin admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:43:35.807962 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.notifications [None req-38296170-947f-4a15-a6bf-ca918edd92cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01809e3784b941869911443a3d0cd044', 'request_id': 'req-38296170-947f-4a15-a6bf-ca918edd92cc'} {{(pid=88080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:43:35.813735 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.notifications [None req-38296170-947f-4a15-a6bf-ca918edd92cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01809e3784b941869911443a3d0cd044', 'request_id': 'req-38296170-947f-4a15-a6bf-ca918edd92cc'} {{(pid=88080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:43:35.821792 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.notifications [None req-38296170-947f-4a15-a6bf-ca918edd92cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01809e3784b941869911443a3d0cd044', 'request_id': 'req-38296170-947f-4a15-a6bf-ca918edd92cc'} {{(pid=88080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:43:35.839874 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.notifications [None req-38296170-947f-4a15-a6bf-ca918edd92cc admin admin] The token cache is being invalidate because project 01809e3784b941869911443a3d0cd044 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 19:43:35.840164 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.notifications [None req-38296170-947f-4a15-a6bf-ca918edd92cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:43:35.840815 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.notifications [None req-38296170-947f-4a15-a6bf-ca918edd92cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:43:35.842521 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 631/1259] 10.222.0.18 () {58 vars in 1233 bytes} [Sat Sep 24 19:43:35 2022] DELETE /identity/v3/projects/01809e3784b941869911443a3d0cd044 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:43:35.847862 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dd0eb3-9e85-4140-a732-8d8ef2c59825 admin admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:43:35.849640 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.fernet_utils [None req-f9dd0eb3-9e85-4140-a732-8d8ef2c59825 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:43:35.863156 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dd0eb3-9e85-4140-a732-8d8ef2c59825 admin admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:43:35.917732 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d827315-9ee8-45b5-81f1-1d77ab452ae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fc67bd325c24a418945f738b4bd5c71', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:43:35.918434 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d827315-9ee8-45b5-81f1-1d77ab452ae5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:43:35.918658 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d827315-9ee8-45b5-81f1-1d77ab452ae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:43:35.918932 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d827315-9ee8-45b5-81f1-1d77ab452ae5 admin admin] PATH_INFO: `/v3/users/866a9e7e36134d7289795fced1f88306` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:43:35.920029 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d827315-9ee8-45b5-81f1-1d77ab452ae5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=866a9e7e36134d7289795fced1f88306)` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:43:35.921984 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d827315-9ee8-45b5-81f1-1d77ab452ae5 admin admin] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:43:35.968148 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.notifications [None req-2d827315-9ee8-45b5-81f1-1d77ab452ae5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '866a9e7e36134d7289795fced1f88306'} {{(pid=88081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:43:35.968851 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.notifications [None req-2d827315-9ee8-45b5-81f1-1d77ab452ae5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '866a9e7e36134d7289795fced1f88306'} {{(pid=88081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:43:35.969445 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.notifications [None req-2d827315-9ee8-45b5-81f1-1d77ab452ae5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '866a9e7e36134d7289795fced1f88306'} {{(pid=88081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:43:35.979356 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.notifications [None req-2d827315-9ee8-45b5-81f1-1d77ab452ae5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '866a9e7e36134d7289795fced1f88306'} {{(pid=88081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:43:35.987334 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.notifications [None req-2d827315-9ee8-45b5-81f1-1d77ab452ae5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '866a9e7e36134d7289795fced1f88306'} {{(pid=88081) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:43:35.995060 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:43:36.006586 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 629/1260] 10.222.0.18 () {58 vars in 1224 bytes} [Sat Sep 24 19:43:35 2022] DELETE /identity/v3/users/866a9e7e36134d7289795fced1f88306 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:43:36.179385 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38296170-947f-4a15-a6bf-ca918edd92cc admin admin] Authenticating user token {{(pid=88080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:43:36.180922 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.fernet_utils [None req-38296170-947f-4a15-a6bf-ca918edd92cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:43:36.191352 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:43:36.195370 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38296170-947f-4a15-a6bf-ca918edd92cc admin admin] Validating token access rules against request {{(pid=88080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:43:36.254642 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bb8e18-5574-4861-954e-1d7a1dd804f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dbbb9909cec43ff99c1c3682f016ef8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9fc67bd325c24a418945f738b4bd5c71', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:43:36.255272 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bb8e18-5574-4861-954e-1d7a1dd804f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:43:36.255554 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bb8e18-5574-4861-954e-1d7a1dd804f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:43:36.255824 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bb8e18-5574-4861-954e-1d7a1dd804f5 admin admin] PATH_INFO: `/v3/projects/5c17b8437cff4a33a10d65729e14305f` {{(pid=88080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:43:36.256931 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bb8e18-5574-4861-954e-1d7a1dd804f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c17b8437cff4a33a10d65729e14305f)` {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:43:36.258945 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bb8e18-5574-4861-954e-1d7a1dd804f5 admin admin] RBAC: Authorization granted {{(pid=88080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:43:36.305491 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.notifications [None req-e4bb8e18-5574-4861-954e-1d7a1dd804f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c17b8437cff4a33a10d65729e14305f', 'request_id': 'req-e4bb8e18-5574-4861-954e-1d7a1dd804f5'} {{(pid=88080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:43:36.310860 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.notifications [None req-e4bb8e18-5574-4861-954e-1d7a1dd804f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c17b8437cff4a33a10d65729e14305f', 'request_id': 'req-e4bb8e18-5574-4861-954e-1d7a1dd804f5'} {{(pid=88080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:43:36.319831 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.notifications [None req-e4bb8e18-5574-4861-954e-1d7a1dd804f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c17b8437cff4a33a10d65729e14305f', 'request_id': 'req-e4bb8e18-5574-4861-954e-1d7a1dd804f5'} {{(pid=88080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:43:36.332310 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.notifications [None req-e4bb8e18-5574-4861-954e-1d7a1dd804f5 admin admin] The token cache is being invalidate because project 5c17b8437cff4a33a10d65729e14305f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 19:43:36.332586 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.notifications [None req-e4bb8e18-5574-4861-954e-1d7a1dd804f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:43:36.333226 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG keystone.notifications [None req-e4bb8e18-5574-4861-954e-1d7a1dd804f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 19:43:36.334732 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: [pid: 88080|app: 0|req: 632/1261] 10.222.0.18 () {58 vars in 1233 bytes} [Sat Sep 24 19:43:36 2022] DELETE /identity/v3/projects/5c17b8437cff4a33a10d65729e14305f => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 19:43:46.004757 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=3,keystone:DELETE=1 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:43:46.328875 dv-osbrick-859195-1-ceph devstack@keystone.service[88080]: DEBUG dbcounter [-] [88080] Writing DB stats keystone:SELECT=49,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 19:47:09.097189 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d827315-9ee8-45b5-81f1-1d77ab452ae5 admin admin] Authenticating user token {{(pid=88081) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 19:47:09.098599 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.fernet_utils [None req-2d827315-9ee8-45b5-81f1-1d77ab452ae5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:47:09.179663 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d827315-9ee8-45b5-81f1-1d77ab452ae5 admin admin] Validating token access rules against request {{(pid=88081) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 19:47:09.237692 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d58aec2-8b29-41b7-a3d3-8355493959ad service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2dfc6ff4e9b4d30b28d39d678b19896', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9dfa5c2c17244006bdd629ec81553f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88081) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 19:47:09.238328 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d58aec2-8b29-41b7-a3d3-8355493959ad service placement] REQUEST_METHOD: `GET` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 19:47:09.238611 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d58aec2-8b29-41b7-a3d3-8355493959ad service placement] SCRIPT_NAME: `/identity` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 19:47:09.238893 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d58aec2-8b29-41b7-a3d3-8355493959ad service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88081) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 19:47:09.240637 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.fernet_utils [None req-2d58aec2-8b29-41b7-a3d3-8355493959ad service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88081) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 19:47:09.251442 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d58aec2-8b29-41b7-a3d3-8355493959ad service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 19:47:09.252999 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d58aec2-8b29-41b7-a3d3-8355493959ad service placement] RBAC: Authorization granted {{(pid=88081) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 19:47:09.262600 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: [pid: 88081|app: 0|req: 630/1262] 10.222.0.18 () {60 vars in 1365 bytes} [Sat Sep 24 19:47:09 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 19:47:19.258561 dv-osbrick-859195-1-ceph devstack@keystone.service[88081]: DEBUG dbcounter [-] [88081] Writing DB stats keystone:SELECT=62 {{(pid=88081) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}